2023-10-06T04:02:28.699 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:02:28.699 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250 --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/orig.config.yaml 2023-10-06T04:02:28.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:02:28.826 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} email: yweinste@redhat.com first_in_suite: false job_id: '7412250' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC86wr1epLFbSfu8kXLD/mAFRYoAYEm737l133EOAsPylg5zNKnwXLt8DWx+LiEOROKV1INS76Nhw67lviJRgD8= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7DKOYjzxAnIu5A0szzJ095WnezlykVsQEtF7MrxPlN8VW8MSmRu4CXSgREMecIHe4iXfoDPxKJffjUr19J6mU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:02:28.827 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T04:02:28.828 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T04:02:28.828 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:02:28.830 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:02:28.854 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T04:02:28.854 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:02:28.854 INFO:teuthology.packaging:ref: None 2023-10-06T04:02:28.854 INFO:teuthology.packaging:tag: None 2023-10-06T04:02:28.855 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T04:02:28.855 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T04:02:28.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T04:02:29.079 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T04:02:29.079 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:02:29.086 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:02:29.086 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:02:29.094 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:02:29.109 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:02:29.116 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:02:29.141 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:57:36.456925', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC86wr1epLFbSfu8kXLD/mAFRYoAYEm737l133EOAsPylg5zNKnwXLt8DWx+LiEOROKV1INS76Nhw67lviJRgD8='} 2023-10-06T04:02:29.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:57:36.454974', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7DKOYjzxAnIu5A0szzJ095WnezlykVsQEtF7MrxPlN8VW8MSmRu4CXSgREMecIHe4iXfoDPxKJffjUr19J6mU='} 2023-10-06T04:02:29.163 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:02:29.169 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:02:29.169 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:02:29.169 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:02:29.234 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6e67545b80>, signals=[15]) 2023-10-06T04:02:29.235 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:02:29.241 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:02:29.241 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:02:29.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:02:29.310 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:02:29.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:02:29.376 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:02:29.383 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-10-06T04:02:29.401 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-10-06T04:02:29.401 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:02:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:02:29.459 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:02:29.460 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-06T04:02:29.485 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-06T04:02:29.502 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-06T04:02:29.502 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-06T04:02:29.558 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:02:29.558 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:02:29.558 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:02:29.559 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:02:29.560 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:02:29.560 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:02:29.560 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:02:29.560 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-06T04:02:29.584 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:02:29.595 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:02:29.607 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:02:29.607 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:02:29.610 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:02:29.626 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:02:29.633 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:02:29.633 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:02:29.667 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:02:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:02:29.683 INFO:teuthology.orchestra.run.smithi083.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:02:29.684 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:02:29.735 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:02:29.750 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:02:29.750 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T04:02:29.750 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T04:02:29.750 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:02:29.751 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:02:29.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:02:29.767 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T04:02:29.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:02:29.772 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T04:02:29.823 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:02:29.823 INFO:teuthology.task.kernel:Running kernel on smithi083: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:02:29.824 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2023-10-06T04:02:29.828 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:02:29.829 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:02:29.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2023-10-06T04:02:31.252 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:31.252 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T04:02:31.309 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:31.310 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T04:02:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-10-06T04:02:32.996 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 6.9 kB/s | 3.5 kB 00:00 2023-10-06T04:02:33.684 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-06T04:02:33.999 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-06T04:02:36.953 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 1.8 MB/s | 24 kB 00:00 2023-10-06T04:02:37.033 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 04:02:36 AM UTC. 2023-10-06T04:02:37.505 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T04:02:37.659 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:02:37.659 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:02:37.659 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:02:37.812 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T04:02:37.813 INFO:teuthology.orchestra.run.smithi083.stdout:Nothing to do. 2023-10-06T04:02:37.813 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T04:02:37.921 DEBUG:teuthology.orchestra.run.smithi083:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:02:38.264 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:38.265 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T04:02:38.314 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:02:38.314 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:02:38.314 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:02:38.477 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-06T04:02:38.479 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-10-06T04:02:38.479 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-06T04:02:38.558 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:02:36 AM UTC. 2023-10-06T04:02:38.580 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:02:38.681 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:02:38.682 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:38.682 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:38.708 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-10-06T04:02:38.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum reinstall -y kernel || true 2023-10-06T04:02:38.945 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:38.946 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T04:02:39.098 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:39.098 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-10-06T04:02:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:02:37 AM UTC. 2023-10-06T04:02:39.378 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 04:02:36 AM UTC. 2023-10-06T04:02:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:02:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-06T04:02:39.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2023-10-06T04:02:39.514 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:02:39.514 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:39.514 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:39.529 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-10-06T04:02:39.579 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:02:39.704 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.705 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.705 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.705 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:02:39.705 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:02:39.705 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T04:02:39.705 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:02:39.705 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:02:39.829 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.829 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2023-10-06T04:02:39.832 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:02:39.832 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T04:02:39.856 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.02 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 99.el8_4.1 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Group : System Environment/Base 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 9264631 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:02:39.857 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Relocations : (not relocatable) 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : Red Hat, Inc. 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:02:39.858 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:02:39.859 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2023-10-06T04:02:39.859 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:02:39.859 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:02:39.860 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:02:39.860 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:39.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:02:40.130 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 04:02:37 AM UTC. 2023-10-06T04:02:40.266 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:02:40.267 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:40.267 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:02:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-06T04:02:40.329 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:02:40.462 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.462 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.462 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.462 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:02:40.462 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:02:40.462 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T04:02:40.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:02:40.463 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:02:40.593 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.593 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 99.el8_4.1 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 9264631 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-10-06T04:02:40.623 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : Red Hat, Inc. 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:02:40.624 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:02:40.625 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:02:40.625 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-10-06T04:02:40.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:02:40.625 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:02:40.626 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:02:40.626 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:40.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:02:41.256 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2023-10-06T04:02:41.850 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-10-06T04:02:43.416 INFO:teuthology.orchestra.run.smithi083.stderr:done 2023-10-06T04:02:43.418 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:02:43.432 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.CnHfiRPxzf 2023-10-06T04:02:43.432 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CnHfiRPxzf 2023-10-06T04:02:43.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.CnHfiRPxzf 2023-10-06T04:02:43.639 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.CnHfiRPxzf is 6KB 2023-10-06T04:02:43.686 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.CnHfiRPxzf 2023-10-06T04:02:43.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:02:43.774 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:02:43.774 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:02:43.774 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:02:43.774 INFO:teuthology.orchestra.run.smithi083.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:02:43.775 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:43.931 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-10-06T04:02:43.933 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T04:02:43.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2023-10-06T04:02:43.958 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.4Jf5z2sI83 2023-10-06T04:02:43.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4Jf5z2sI83 2023-10-06T04:02:44.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.4Jf5z2sI83 2023-10-06T04:02:44.181 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.4Jf5z2sI83 is 6KB 2023-10-06T04:02:44.229 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.4Jf5z2sI83 2023-10-06T04:02:44.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:02:44.313 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:02:44.313 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:02:44.314 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:02:44.314 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:02:44.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:02:44.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-10-06T04:03:13.967 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:03:13.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:03:13.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:03:14.504 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:03:14.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:03:14.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:03:32.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:03:32.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T04:03:41.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:03:41.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:03:41.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:03:41.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:03:44.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:03:56.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:03:56.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:03:59.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:04:00.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T04:04:12.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:04:12.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:04:14.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:04:14.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:04:14.909 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T04:04:15.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:04:15.225 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:04:15.225 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T04:04:15.242 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:04:15.242 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:04:15.243 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:04:15.243 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:04:16.244 DEBUG:teuthology.parallel:result is None 2023-10-06T04:04:17.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-06T04:04:35.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:04:35.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:04:35.913 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T04:04:36.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:04:36.196 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:04:36.196 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-10-06T04:04:36.214 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:04:36.214 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:04:36.214 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:04:36.214 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:04:37.215 DEBUG:teuthology.parallel:result is None 2023-10-06T04:04:37.216 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:04:37.224 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:04:37.224 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:04:37.228 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:04:37.246 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:04:37.254 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:04:37.261 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:04:37.261 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:04:37.288 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:04:37.321 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:04:37.328 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:04:37.328 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:04:37.359 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:04:37.441 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:04:37.462 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:04:37.474 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:04:37.490 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:04:37.491 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:04:37.499 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:04:37.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:04:37.501 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:04:37.529 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:04:37.538 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:04:37.538 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:04:37.570 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:04:37.585 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:04:37.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:04:37.709 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:04:37.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:04:37.834 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:04:37.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:04:37.900 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:04:37.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:04:38.016 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:04:38.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:04:38.099 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:04:38.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:04:38.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-10-06T04:04:38.167 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2023-10-06T04:04:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:04:38.254 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:04:38.699 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:04:38.708 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:04:38.708 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:04:38.717 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:04:38.726 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:04:38.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-10-06T04:04:38.784 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: [ OK ] 2023-10-06T04:04:38.786 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2023-10-06T04:04:38.865 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: [ OK ] 2023-10-06T04:04:38.866 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:04:38.866 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-10-06T04:04:38.890 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-10-06T04:04:38.890 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2023-10-06T04:04:38.915 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2023-10-06T04:04:38.915 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:04:38.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:04:38.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:04:38.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:04:38.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:04:38.981 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:04:38.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:04:39.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:04:39.047 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:04:39.057 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T04:04:39.057 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:04:39.073 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:04:39.074 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:13:23.094 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2023-10-06T04:13:23.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:13:23.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:13:23.165 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T04:13:23.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T04:13:23.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:13:23.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:13:23.304 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-06T04:13:23.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-06T04:13:23.369 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:13:23.383 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:13:23.383 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:13:23.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:13:23.385 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:13:23.386 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:13:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:13:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:13:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:13:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:13:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-10-06T04:13:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-10-06T04:13:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:13:23.488 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2023-10-06T04:13:23.498 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2023-10-06T04:13:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:13:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:13:23.526 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:13:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:210 Number of sources = 4 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.595 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T04:13:23.597 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.598 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:13:23.599 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:13:23.607 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:13:23.607 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T04:13:23.607 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T04:13:23.608 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:13:23.613 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:13:23.613 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:13:23.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T04:13:23.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T04:13:23.616 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T04:13:23.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T04:13:23.769 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T04:13:23.770 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T04:13:23.842 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T04:13:23.842 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T04:13:23.899 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:13:23.899 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:13:23.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:13:23.925 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:13:23.925 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:13:23.949 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:13:23.949 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:13:23.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:13:23.975 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:13:23.975 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:13:23.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:13:24.040 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:13:24.067 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:13:24.115 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:13:24.131 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-10-06T04:13:24.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-10-06T04:13:24.179 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2023-10-06T04:13:24.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2023-10-06T04:13:24.545 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:13:24.573 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T04:13:25.251 INFO:teuthology.orchestra.run.smithi083.stdout:44 files removed 2023-10-06T04:13:25.274 INFO:teuthology.orchestra.run.smithi037.stdout:44 files removed 2023-10-06T04:13:25.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:13:25.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:13:25.649 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-10-06T04:13:25.698 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:13:27.603 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 112 kB/s | 78 kB 00:00 2023-10-06T04:13:27.736 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 78 kB/s | 78 kB 00:01 2023-10-06T04:13:27.921 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 33 kB/s | 9.2 kB 00:00 2023-10-06T04:13:28.443 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 14 kB/s | 9.2 kB 00:00 2023-10-06T04:13:28.512 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 2.6 kB/s | 1.4 kB 00:00 2023-10-06T04:13:28.742 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-06T04:13:29.055 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2023-10-06T04:13:29.257 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-06T04:13:30.444 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2023-10-06T04:13:31.036 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-10-06T04:13:33.930 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-10-06T04:13:34.292 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T04:13:34.339 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 MB/s | 33 MB 00:00 2023-10-06T04:13:34.694 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 120 MB/s | 38 MB 00:00 2023-10-06T04:13:39.985 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 100 MB/s | 38 MB 00:00 2023-10-06T04:13:40.224 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 110 MB/s | 33 MB 00:00 2023-10-06T04:13:48.073 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:13:48.074 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:13:48.085 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:13:48.085 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:13:48.086 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:13:48.087 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:13:48.089 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:13:48.091 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:13:48.092 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:13:48.579 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-10-06T04:13:48.590 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T04:13:48.590 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2023-10-06T04:13:48.590 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T04:13:48.590 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T04:13:48.591 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:13:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:13:48.593 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T04:13:48.594 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T04:13:48.594 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T04:13:48.594 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T04:13:48.594 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T04:13:48.594 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T04:13:48.595 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T04:13:48.596 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:13:48.597 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:13:48.598 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:13:48.599 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:13:48.600 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:13:48.601 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:13:48.602 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================================== 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout:Install 118 Packages 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 2 Packages 2023-10-06T04:13:48.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:13:48.604 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 201 M 2023-10-06T04:13:48.604 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2023-10-06T04:13:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:13:48.866 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:13:48.877 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:13:48.878 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:13:48.879 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:13:48.880 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:13:48.881 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:13:48.884 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:13:48.885 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:13:49.127 INFO:teuthology.orchestra.run.smithi083.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2023-10-06T04:13:49.396 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T04:13:49.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T04:13:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T04:13:49.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T04:13:49.412 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:13:49.413 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:13:49.414 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:13:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:13:49.416 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:13:49.417 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:13:49.418 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:13:49.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout:Install 118 Packages 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:13:49.420 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 201 M 2023-10-06T04:13:49.421 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-10-06T04:13:49.499 INFO:teuthology.orchestra.run.smithi083.stdout:(2/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 9.8 MB/s | 5.2 MB 00:00 2023-10-06T04:13:49.528 INFO:teuthology.orchestra.run.smithi083.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 5.4 MB/s | 162 kB 00:00 2023-10-06T04:13:49.780 INFO:teuthology.orchestra.run.smithi083.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 9.2 MB/s | 2.3 MB 00:00 2023-10-06T04:13:49.939 INFO:teuthology.orchestra.run.smithi037.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-10-06T04:13:49.949 INFO:teuthology.orchestra.run.smithi083.stdout:(5/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.0 MB/s | 876 kB 00:00 2023-10-06T04:13:49.962 INFO:teuthology.orchestra.run.smithi083.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 8.6 MB/s | 1.6 MB 00:00 2023-10-06T04:13:51.293 INFO:teuthology.orchestra.run.smithi037.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 647 kB/s | 876 kB 00:01 2023-10-06T04:13:51.507 INFO:teuthology.orchestra.run.smithi037.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 756 kB/s | 162 kB 00:00 2023-10-06T04:13:51.761 INFO:teuthology.orchestra.run.smithi083.stdout:(7/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 8.4 MB/s | 23 MB 00:02 2023-10-06T04:13:52.144 INFO:teuthology.orchestra.run.smithi083.stdout:(8/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 1.8 MB/s | 3.9 MB 00:02 2023-10-06T04:13:52.224 INFO:teuthology.orchestra.run.smithi083.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 305 kB/s | 24 kB 00:00 2023-10-06T04:13:52.945 INFO:teuthology.orchestra.run.smithi083.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 5.6 MB/s | 17 MB 00:02 2023-10-06T04:13:53.024 INFO:teuthology.orchestra.run.smithi083.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.2 MB/s | 255 kB 00:00 2023-10-06T04:13:53.091 INFO:teuthology.orchestra.run.smithi083.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 373 kB/s | 25 kB 00:00 2023-10-06T04:13:53.119 INFO:teuthology.orchestra.run.smithi037.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 1.5 MB/s | 5.2 MB 00:03 2023-10-06T04:13:53.312 INFO:teuthology.orchestra.run.smithi083.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 3.5 MB/s | 797 kB 00:00 2023-10-06T04:13:53.376 INFO:teuthology.orchestra.run.smithi083.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.7 MB/s | 174 kB 00:00 2023-10-06T04:13:53.434 INFO:teuthology.orchestra.run.smithi083.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 2.2 MB/s | 130 kB 00:00 2023-10-06T04:13:53.558 INFO:teuthology.orchestra.run.smithi083.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 4.0 MB/s | 507 kB 00:00 2023-10-06T04:13:53.683 INFO:teuthology.orchestra.run.smithi037.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-10-06T04:13:53.720 INFO:teuthology.orchestra.run.smithi037.stdout:(6/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 1.0 MB/s | 2.3 MB 00:02 2023-10-06T04:13:54.741 INFO:teuthology.orchestra.run.smithi083.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 4.7 MB/s | 5.6 MB 00:01 2023-10-06T04:13:54.800 INFO:teuthology.orchestra.run.smithi083.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 756 kB/s | 45 kB 00:00 2023-10-06T04:13:54.868 INFO:teuthology.orchestra.run.smithi083.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.7 MB/s | 115 kB 00:00 2023-10-06T04:13:54.938 INFO:teuthology.orchestra.run.smithi083.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.6 MB/s | 190 kB 00:00 2023-10-06T04:13:54.966 INFO:teuthology.orchestra.run.smithi037.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 3.1 MB/s | 3.9 MB 00:01 2023-10-06T04:13:55.072 INFO:teuthology.orchestra.run.smithi083.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 2.7 MB/s | 371 kB 00:00 2023-10-06T04:13:55.210 INFO:teuthology.orchestra.run.smithi083.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 2.5 MB/s | 358 kB 00:00 2023-10-06T04:13:55.274 INFO:teuthology.orchestra.run.smithi083.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.6 MB/s | 107 kB 00:00 2023-10-06T04:13:55.343 INFO:teuthology.orchestra.run.smithi083.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.3 MB/s | 90 kB 00:00 2023-10-06T04:13:55.487 INFO:teuthology.orchestra.run.smithi083.stdout:(25/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 4.5 MB/s | 17 MB 00:03 2023-10-06T04:13:55.560 INFO:teuthology.orchestra.run.smithi083.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.3 MB/s | 173 kB 00:00 2023-10-06T04:13:55.630 INFO:teuthology.orchestra.run.smithi083.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 332 kB/s | 23 kB 00:00 2023-10-06T04:13:55.701 INFO:teuthology.orchestra.run.smithi083.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.7 MB/s | 121 kB 00:00 2023-10-06T04:13:56.102 INFO:teuthology.orchestra.run.smithi083.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 4.5 MB/s | 3.5 MB 00:00 2023-10-06T04:13:56.141 INFO:teuthology.orchestra.run.smithi083.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 3.9 MB/s | 1.7 MB 00:00 2023-10-06T04:13:56.208 INFO:teuthology.orchestra.run.smithi083.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.5 MB/s | 238 kB 00:00 2023-10-06T04:13:56.270 INFO:teuthology.orchestra.run.smithi083.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 767 kB/s | 47 kB 00:00 2023-10-06T04:13:56.328 INFO:teuthology.orchestra.run.smithi083.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 250 kB/s | 14 kB 00:00 2023-10-06T04:13:56.397 INFO:teuthology.orchestra.run.smithi083.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.8 MB/s | 267 kB 00:00 2023-10-06T04:13:56.462 INFO:teuthology.orchestra.run.smithi083.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T04:13:56.522 INFO:teuthology.orchestra.run.smithi083.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 300 kB/s | 18 kB 00:00 2023-10-06T04:13:56.885 INFO:teuthology.orchestra.run.smithi083.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 844 kB/s | 306 kB 00:00 2023-10-06T04:13:56.940 INFO:teuthology.orchestra.run.smithi083.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-10-06T04:13:56.996 INFO:teuthology.orchestra.run.smithi083.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-06T04:13:57.099 INFO:teuthology.orchestra.run.smithi083.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.5 MB/s | 476 kB 00:00 2023-10-06T04:13:57.149 INFO:teuthology.orchestra.run.smithi083.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 882 kB/s | 44 kB 00:00 2023-10-06T04:13:57.206 INFO:teuthology.orchestra.run.smithi083.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-10-06T04:13:57.255 INFO:teuthology.orchestra.run.smithi083.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 678 kB/s | 33 kB 00:00 2023-10-06T04:13:57.304 INFO:teuthology.orchestra.run.smithi083.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 332 kB/s | 16 kB 00:00 2023-10-06T04:13:57.359 INFO:teuthology.orchestra.run.smithi083.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.1 MB/s | 173 kB 00:00 2023-10-06T04:13:57.425 INFO:teuthology.orchestra.run.smithi083.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 384 kB 00:00 2023-10-06T04:13:57.482 INFO:teuthology.orchestra.run.smithi083.stdout:(47/120): ceph-mgr-diskprediction-local-17.2.6- 5.4 MB/s | 7.4 MB 00:01 2023-10-06T04:13:57.490 INFO:teuthology.orchestra.run.smithi083.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-06T04:13:57.554 INFO:teuthology.orchestra.run.smithi083.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 276 kB/s | 18 kB 00:00 2023-10-06T04:13:57.714 INFO:teuthology.orchestra.run.smithi083.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 48 kB/s | 11 kB 00:00 2023-10-06T04:13:57.759 INFO:teuthology.orchestra.run.smithi083.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 5.7 MB/s | 1.2 MB 00:00 2023-10-06T04:13:57.830 INFO:teuthology.orchestra.run.smithi083.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 820 kB/s | 59 kB 00:00 2023-10-06T04:13:57.887 INFO:teuthology.orchestra.run.smithi083.stdout:(53/120): python3-logutils-0.3.5-11.el8.noarch. 282 kB/s | 49 kB 00:00 2023-10-06T04:13:57.906 INFO:teuthology.orchestra.run.smithi083.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 799 kB/s | 60 kB 00:00 2023-10-06T04:13:57.974 INFO:teuthology.orchestra.run.smithi083.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 230 kB/s | 16 kB 00:00 2023-10-06T04:13:58.044 INFO:teuthology.orchestra.run.smithi083.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 481 kB/s | 34 kB 00:00 2023-10-06T04:13:58.116 INFO:teuthology.orchestra.run.smithi083.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.7 MB/s | 196 kB 00:00 2023-10-06T04:13:58.127 INFO:teuthology.orchestra.run.smithi083.stdout:(58/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-10-06T04:13:58.188 INFO:teuthology.orchestra.run.smithi083.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 892 kB/s | 64 kB 00:00 2023-10-06T04:13:58.199 INFO:teuthology.orchestra.run.smithi083.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 259 kB/s | 19 kB 00:00 2023-10-06T04:13:58.254 INFO:teuthology.orchestra.run.smithi083.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 366 kB/s | 24 kB 00:00 2023-10-06T04:13:58.271 INFO:teuthology.orchestra.run.smithi083.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 410 kB/s | 29 kB 00:00 2023-10-06T04:13:58.324 INFO:teuthology.orchestra.run.smithi083.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 392 kB/s | 27 kB 00:00 2023-10-06T04:13:58.377 INFO:teuthology.orchestra.run.smithi083.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.4 MB/s | 255 kB 00:00 2023-10-06T04:13:58.402 INFO:teuthology.orchestra.run.smithi083.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-10-06T04:13:58.457 INFO:teuthology.orchestra.run.smithi083.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 771 kB/s | 61 kB 00:00 2023-10-06T04:13:58.475 INFO:teuthology.orchestra.run.smithi083.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-06T04:13:58.525 INFO:teuthology.orchestra.run.smithi083.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 338 kB/s | 23 kB 00:00 2023-10-06T04:13:58.528 INFO:teuthology.orchestra.run.smithi083.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-06T04:13:58.644 INFO:teuthology.orchestra.run.smithi083.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-06T04:13:58.648 INFO:teuthology.orchestra.run.smithi083.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 156 kB/s | 19 kB 00:00 2023-10-06T04:13:58.759 INFO:teuthology.orchestra.run.smithi083.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 371 kB/s | 43 kB 00:00 2023-10-06T04:13:58.772 INFO:teuthology.orchestra.run.smithi083.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-10-06T04:13:58.849 INFO:teuthology.orchestra.run.smithi083.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.4 MB/s | 220 kB 00:00 2023-10-06T04:13:58.891 INFO:teuthology.orchestra.run.smithi083.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 403 kB/s | 48 kB 00:00 2023-10-06T04:13:58.993 INFO:teuthology.orchestra.run.smithi083.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 419 kB/s | 43 kB 00:00 2023-10-06T04:13:59.019 INFO:teuthology.orchestra.run.smithi083.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-10-06T04:13:59.128 INFO:teuthology.orchestra.run.smithi083.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 163 kB/s | 18 kB 00:00 2023-10-06T04:13:59.161 INFO:teuthology.orchestra.run.smithi083.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 14 MB/s | 2.3 MB 00:00 2023-10-06T04:13:59.236 INFO:teuthology.orchestra.run.smithi083.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-10-06T04:13:59.318 INFO:teuthology.orchestra.run.smithi083.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2023-10-06T04:13:59.360 INFO:teuthology.orchestra.run.smithi083.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 472 kB/s | 59 kB 00:00 2023-10-06T04:13:59.434 INFO:teuthology.orchestra.run.smithi083.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.4 MB/s | 169 kB 00:00 2023-10-06T04:13:59.516 INFO:teuthology.orchestra.run.smithi083.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 246 kB/s | 38 kB 00:00 2023-10-06T04:13:59.536 INFO:teuthology.orchestra.run.smithi083.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 840 kB/s | 86 kB 00:00 2023-10-06T04:13:59.551 INFO:teuthology.orchestra.run.smithi083.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.6 MB/s | 58 kB 00:00 2023-10-06T04:13:59.578 INFO:teuthology.orchestra.run.smithi083.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-06T04:13:59.650 INFO:teuthology.orchestra.run.smithi083.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 5.5 MB/s | 559 kB 00:00 2023-10-06T04:13:59.659 INFO:teuthology.orchestra.run.smithi083.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 7.8 MB/s | 639 kB 00:00 2023-10-06T04:13:59.696 INFO:teuthology.orchestra.run.smithi083.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 5.3 MB/s | 200 kB 00:00 2023-10-06T04:13:59.746 INFO:teuthology.orchestra.run.smithi083.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 733 kB/s | 70 kB 00:00 2023-10-06T04:13:59.791 INFO:teuthology.orchestra.run.smithi083.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 1.0 MB/s | 97 kB 00:00 2023-10-06T04:13:59.942 INFO:teuthology.orchestra.run.smithi083.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 291 kB/s | 44 kB 00:00 2023-10-06T04:14:00.109 INFO:teuthology.orchestra.run.smithi083.stdout:(94/120): python3-scipy-1.0.0-20.module+el8.1.0 40 MB/s | 15 MB 00:00 2023-10-06T04:14:00.110 INFO:teuthology.orchestra.run.smithi083.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 158 kB/s | 27 kB 00:00 2023-10-06T04:14:00.163 INFO:teuthology.orchestra.run.smithi083.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 3.0 MB/s | 161 kB 00:00 2023-10-06T04:14:00.171 INFO:teuthology.orchestra.run.smithi083.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 5.1 MB/s | 320 kB 00:00 2023-10-06T04:14:00.199 INFO:teuthology.orchestra.run.smithi083.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 12 MB/s | 457 kB 00:00 2023-10-06T04:14:00.226 INFO:teuthology.orchestra.run.smithi083.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.4 MB/s | 39 kB 00:00 2023-10-06T04:14:00.248 INFO:teuthology.orchestra.run.smithi083.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 63 MB/s | 4.8 MB 00:00 2023-10-06T04:14:00.279 INFO:teuthology.orchestra.run.smithi083.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.1 MB/s | 259 kB 00:00 2023-10-06T04:14:00.309 INFO:teuthology.orchestra.run.smithi083.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 7.3 MB/s | 225 kB 00:00 2023-10-06T04:14:00.315 INFO:teuthology.orchestra.run.smithi083.stdout:(103/120): bison-3.0.4-10.el8.x86_64.rpm 7.6 MB/s | 688 kB 00:00 2023-10-06T04:14:00.329 INFO:teuthology.orchestra.run.smithi083.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.4 MB/s | 126 kB 00:00 2023-10-06T04:14:00.378 INFO:teuthology.orchestra.run.smithi083.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-06T04:14:00.393 INFO:teuthology.orchestra.run.smithi083.stdout:(106/120): python3-numpy-1.14.3-9.el8.x86_64.rp 48 MB/s | 3.7 MB 00:00 2023-10-06T04:14:00.424 INFO:teuthology.orchestra.run.smithi083.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.8 MB/s | 302 kB 00:00 2023-10-06T04:14:00.425 INFO:teuthology.orchestra.run.smithi083.stdout:(108/120): python3-jinja2-2.10.1-2.el8_0.noarch 11 MB/s | 538 kB 00:00 2023-10-06T04:14:00.533 INFO:teuthology.orchestra.run.smithi083.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 1.0 MB/s | 110 kB 00:00 2023-10-06T04:14:00.535 INFO:teuthology.orchestra.run.smithi083.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-10-06T04:14:00.559 INFO:teuthology.orchestra.run.smithi083.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2023-10-06T04:14:00.571 INFO:teuthology.orchestra.run.smithi083.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 555 kB/s | 20 kB 00:00 2023-10-06T04:14:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:(8/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 3.0 MB/s | 17 MB 00:05 2023-10-06T04:14:00.586 INFO:teuthology.orchestra.run.smithi083.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 26 MB/s | 709 kB 00:00 2023-10-06T04:14:00.592 INFO:teuthology.orchestra.run.smithi083.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.6 MB/s | 54 kB 00:00 2023-10-06T04:14:00.648 INFO:teuthology.orchestra.run.smithi037.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 329 kB/s | 24 kB 00:00 2023-10-06T04:14:00.669 INFO:teuthology.orchestra.run.smithi083.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 57 MB/s | 4.7 MB 00:00 2023-10-06T04:14:00.695 INFO:teuthology.orchestra.run.smithi083.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2023-10-06T04:14:00.703 INFO:teuthology.orchestra.run.smithi083.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-10-06T04:14:00.790 INFO:teuthology.orchestra.run.smithi037.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 2.4 MB/s | 17 MB 00:07 2023-10-06T04:14:00.922 INFO:teuthology.orchestra.run.smithi037.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 1.9 MB/s | 255 kB 00:00 2023-10-06T04:14:00.980 INFO:teuthology.orchestra.run.smithi037.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 429 kB/s | 25 kB 00:00 2023-10-06T04:14:01.273 INFO:teuthology.orchestra.run.smithi037.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 2.7 MB/s | 797 kB 00:00 2023-10-06T04:14:01.345 INFO:teuthology.orchestra.run.smithi037.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.4 MB/s | 174 kB 00:00 2023-10-06T04:14:01.418 INFO:teuthology.orchestra.run.smithi037.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 1.7 MB/s | 130 kB 00:00 2023-10-06T04:14:01.579 INFO:teuthology.orchestra.run.smithi037.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 3.1 MB/s | 507 kB 00:00 2023-10-06T04:14:01.784 INFO:teuthology.orchestra.run.smithi083.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 3.2 MB/s | 3.5 MB 00:01 2023-10-06T04:14:02.250 INFO:teuthology.orchestra.run.smithi083.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 2.3 MB/s | 3.6 MB 00:01 2023-10-06T04:14:02.380 INFO:teuthology.orchestra.run.smithi037.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 6.9 MB/s | 5.6 MB 00:00 2023-10-06T04:14:02.403 INFO:teuthology.orchestra.run.smithi037.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.9 MB/s | 45 kB 00:00 2023-10-06T04:14:02.425 INFO:teuthology.orchestra.run.smithi037.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 5.2 MB/s | 115 kB 00:00 2023-10-06T04:14:02.451 INFO:teuthology.orchestra.run.smithi037.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 7.2 MB/s | 190 kB 00:00 2023-10-06T04:14:02.502 INFO:teuthology.orchestra.run.smithi037.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 7.1 MB/s | 371 kB 00:00 2023-10-06T04:14:02.556 INFO:teuthology.orchestra.run.smithi037.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 6.6 MB/s | 358 kB 00:00 2023-10-06T04:14:02.580 INFO:teuthology.orchestra.run.smithi037.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 4.3 MB/s | 107 kB 00:00 2023-10-06T04:14:02.604 INFO:teuthology.orchestra.run.smithi037.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.7 MB/s | 90 kB 00:00 2023-10-06T04:14:02.981 INFO:teuthology.orchestra.run.smithi037.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 9.2 MB/s | 3.5 MB 00:00 2023-10-06T04:14:03.155 INFO:teuthology.orchestra.run.smithi037.stdout:(26/120): ceph-common-17.2.6-1296.g736ac5ba.el8 1.7 MB/s | 23 MB 00:13 2023-10-06T04:14:03.215 INFO:teuthology.orchestra.run.smithi037.stdout:(27/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 743 kB/s | 173 kB 00:00 2023-10-06T04:14:03.215 INFO:teuthology.orchestra.run.smithi037.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1296.g 386 kB/s | 23 kB 00:00 2023-10-06T04:14:03.238 INFO:teuthology.orchestra.run.smithi037.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 5.2 MB/s | 121 kB 00:00 2023-10-06T04:14:03.630 INFO:teuthology.orchestra.run.smithi037.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 4.1 MB/s | 1.7 MB 00:00 2023-10-06T04:14:03.767 INFO:teuthology.orchestra.run.smithi037.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 1.7 MB/s | 238 kB 00:00 2023-10-06T04:14:03.836 INFO:teuthology.orchestra.run.smithi037.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 687 kB/s | 47 kB 00:00 2023-10-06T04:14:03.905 INFO:teuthology.orchestra.run.smithi037.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 210 kB/s | 14 kB 00:00 2023-10-06T04:14:04.051 INFO:teuthology.orchestra.run.smithi037.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 1.8 MB/s | 267 kB 00:00 2023-10-06T04:14:04.111 INFO:teuthology.orchestra.run.smithi037.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.3 MB/s | 80 kB 00:00 2023-10-06T04:14:04.161 INFO:teuthology.orchestra.run.smithi037.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 362 kB/s | 18 kB 00:00 2023-10-06T04:14:04.301 INFO:teuthology.orchestra.run.smithi037.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 7.0 MB/s | 7.4 MB 00:01 2023-10-06T04:14:04.369 INFO:teuthology.orchestra.run.smithi037.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-06T04:14:04.405 INFO:teuthology.orchestra.run.smithi037.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.0 MB/s | 75 kB 00:00 2023-10-06T04:14:04.435 INFO:teuthology.orchestra.run.smithi037.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 439 kB/s | 59 kB 00:00 2023-10-06T04:14:04.478 INFO:teuthology.orchestra.run.smithi037.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.5 MB/s | 476 kB 00:00 2023-10-06T04:14:04.483 INFO:teuthology.orchestra.run.smithi037.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 914 kB/s | 44 kB 00:00 2023-10-06T04:14:04.525 INFO:teuthology.orchestra.run.smithi037.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.9 MB/s | 185 kB 00:00 2023-10-06T04:14:04.531 INFO:teuthology.orchestra.run.smithi037.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 688 kB/s | 33 kB 00:00 2023-10-06T04:14:04.556 INFO:teuthology.orchestra.run.smithi037.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 530 kB/s | 16 kB 00:00 2023-10-06T04:14:04.599 INFO:teuthology.orchestra.run.smithi037.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.8 MB/s | 384 kB 00:00 2023-10-06T04:14:04.626 INFO:teuthology.orchestra.run.smithi037.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-06T04:14:04.631 INFO:teuthology.orchestra.run.smithi037.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-06T04:14:04.657 INFO:teuthology.orchestra.run.smithi037.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 357 kB/s | 11 kB 00:00 2023-10-06T04:14:04.663 INFO:teuthology.orchestra.run.smithi037.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 568 kB/s | 18 kB 00:00 2023-10-06T04:14:04.701 INFO:teuthology.orchestra.run.smithi037.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.3 MB/s | 49 kB 00:00 2023-10-06T04:14:04.733 INFO:teuthology.orchestra.run.smithi037.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.8 MB/s | 59 kB 00:00 2023-10-06T04:14:04.766 INFO:teuthology.orchestra.run.smithi037.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-10-06T04:14:04.806 INFO:teuthology.orchestra.run.smithi037.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.9 MB/s | 283 kB 00:00 2023-10-06T04:14:04.822 INFO:teuthology.orchestra.run.smithi037.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2023-10-06T04:14:04.837 INFO:teuthology.orchestra.run.smithi037.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 500 kB/s | 16 kB 00:00 2023-10-06T04:14:04.854 INFO:teuthology.orchestra.run.smithi037.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-06T04:14:04.873 INFO:teuthology.orchestra.run.smithi037.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 5.3 MB/s | 196 kB 00:00 2023-10-06T04:14:04.886 INFO:teuthology.orchestra.run.smithi037.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-06T04:14:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 608 kB/s | 19 kB 00:00 2023-10-06T04:14:04.917 INFO:teuthology.orchestra.run.smithi037.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 771 kB/s | 24 kB 00:00 2023-10-06T04:14:04.938 INFO:teuthology.orchestra.run.smithi037.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 900 kB/s | 29 kB 00:00 2023-10-06T04:14:04.948 INFO:teuthology.orchestra.run.smithi037.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 883 kB/s | 27 kB 00:00 2023-10-06T04:14:04.976 INFO:teuthology.orchestra.run.smithi037.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 6.4 MB/s | 255 kB 00:00 2023-10-06T04:14:04.984 INFO:teuthology.orchestra.run.smithi037.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 6.9 MB/s | 251 kB 00:00 2023-10-06T04:14:05.009 INFO:teuthology.orchestra.run.smithi037.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.8 MB/s | 61 kB 00:00 2023-10-06T04:14:05.016 INFO:teuthology.orchestra.run.smithi037.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.6 MB/s | 85 kB 00:00 2023-10-06T04:14:05.040 INFO:teuthology.orchestra.run.smithi037.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 743 kB/s | 23 kB 00:00 2023-10-06T04:14:05.044 INFO:teuthology.orchestra.run.smithi037.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-06T04:14:05.104 INFO:teuthology.orchestra.run.smithi037.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 20 MB/s | 1.7 MB 00:00 2023-10-06T04:14:05.148 INFO:teuthology.orchestra.run.smithi037.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-06T04:14:05.167 INFO:teuthology.orchestra.run.smithi037.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2023-10-06T04:14:05.187 INFO:teuthology.orchestra.run.smithi037.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 8.2 MB/s | 161 kB 00:00 2023-10-06T04:14:05.210 INFO:teuthology.orchestra.run.smithi037.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2023-10-06T04:14:05.236 INFO:teuthology.orchestra.run.smithi037.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 17 MB/s | 457 kB 00:00 2023-10-06T04:14:05.394 INFO:teuthology.orchestra.run.smithi037.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 42 MB/s | 15 MB 00:00 2023-10-06T04:14:05.411 INFO:teuthology.orchestra.run.smithi037.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-10-06T04:14:05.431 INFO:teuthology.orchestra.run.smithi037.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-10-06T04:14:05.440 INFO:teuthology.orchestra.run.smithi037.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2023-10-06T04:14:05.455 INFO:teuthology.orchestra.run.smithi037.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2023-10-06T04:14:05.466 INFO:teuthology.orchestra.run.smithi037.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.8 MB/s | 225 kB 00:00 2023-10-06T04:14:05.479 INFO:teuthology.orchestra.run.smithi037.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.2 MB/s | 126 kB 00:00 2023-10-06T04:14:05.506 INFO:teuthology.orchestra.run.smithi037.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 6.9 MB/s | 187 kB 00:00 2023-10-06T04:14:05.534 INFO:teuthology.orchestra.run.smithi037.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 19 MB/s | 538 kB 00:00 2023-10-06T04:14:05.545 INFO:teuthology.orchestra.run.smithi037.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 47 MB/s | 3.7 MB 00:00 2023-10-06T04:14:05.555 INFO:teuthology.orchestra.run.smithi037.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-06T04:14:05.570 INFO:teuthology.orchestra.run.smithi037.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.1 MB/s | 157 kB 00:00 2023-10-06T04:14:05.581 INFO:teuthology.orchestra.run.smithi037.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2023-10-06T04:14:05.594 INFO:teuthology.orchestra.run.smithi037.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2023-10-06T04:14:05.603 INFO:teuthology.orchestra.run.smithi037.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 914 kB/s | 20 kB 00:00 2023-10-06T04:14:05.623 INFO:teuthology.orchestra.run.smithi037.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-10-06T04:14:05.623 INFO:teuthology.orchestra.run.smithi037.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.6 MB/s | 54 kB 00:00 2023-10-06T04:14:05.721 INFO:teuthology.orchestra.run.smithi037.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 48 MB/s | 4.7 MB 00:00 2023-10-06T04:14:05.739 INFO:teuthology.orchestra.run.smithi037.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 41 MB/s | 4.6 MB 00:00 2023-10-06T04:14:05.749 INFO:teuthology.orchestra.run.smithi037.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2023-10-06T04:14:05.763 INFO:teuthology.orchestra.run.smithi037.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 707 kB/s | 19 kB 00:00 2023-10-06T04:14:05.772 INFO:teuthology.orchestra.run.smithi037.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.8 MB/s | 43 kB 00:00 2023-10-06T04:14:05.783 INFO:teuthology.orchestra.run.smithi037.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.6 MB/s | 155 kB 00:00 2023-10-06T04:14:05.811 INFO:teuthology.orchestra.run.smithi037.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.7 MB/s | 48 kB 00:00 2023-10-06T04:14:05.813 INFO:teuthology.orchestra.run.smithi037.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.3 MB/s | 220 kB 00:00 2023-10-06T04:14:05.838 INFO:teuthology.orchestra.run.smithi037.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.5 MB/s | 229 kB 00:00 2023-10-06T04:14:05.843 INFO:teuthology.orchestra.run.smithi037.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.4 MB/s | 43 kB 00:00 2023-10-06T04:14:05.866 INFO:teuthology.orchestra.run.smithi037.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 869 kB/s | 18 kB 00:00 2023-10-06T04:14:05.903 INFO:teuthology.orchestra.run.smithi037.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 36 MB/s | 2.3 MB 00:00 2023-10-06T04:14:05.943 INFO:teuthology.orchestra.run.smithi037.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2023-10-06T04:14:05.976 INFO:teuthology.orchestra.run.smithi037.stdout:(106/120): elfutils-libelf-devel-0.182-3.el8.x8 1.7 MB/s | 59 kB 00:00 2023-10-06T04:14:05.994 INFO:teuthology.orchestra.run.smithi037.stdout:(107/120): pcre2-devel-10.32-2.el8.x86_64.rpm 4.5 MB/s | 605 kB 00:00 2023-10-06T04:14:06.013 INFO:teuthology.orchestra.run.smithi037.stdout:(108/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.0 MB/s | 38 kB 00:00 2023-10-06T04:14:06.025 INFO:teuthology.orchestra.run.smithi037.stdout:(109/120): libquadmath-8.4.1-1.el8.x86_64.rpm 3.4 MB/s | 169 kB 00:00 2023-10-06T04:14:06.039 INFO:teuthology.orchestra.run.smithi037.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.2 MB/s | 86 kB 00:00 2023-10-06T04:14:06.053 INFO:teuthology.orchestra.run.smithi037.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.0 MB/s | 58 kB 00:00 2023-10-06T04:14:06.074 INFO:teuthology.orchestra.run.smithi083.stdout:(120/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 3.7 MB/s | 52 MB 00:13 2023-10-06T04:14:06.075 INFO:teuthology.orchestra.run.smithi037.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2023-10-06T04:14:06.080 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:14:06.080 INFO:teuthology.orchestra.run.smithi083.stdout:Total 12 MB/s | 201 MB 00:17 2023-10-06T04:14:06.092 INFO:teuthology.orchestra.run.smithi037.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 14 MB/s | 559 kB 00:00 2023-10-06T04:14:06.102 INFO:teuthology.orchestra.run.smithi037.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-06T04:14:06.122 INFO:teuthology.orchestra.run.smithi037.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.3 MB/s | 70 kB 00:00 2023-10-06T04:14:06.132 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2023-10-06T04:14:06.141 INFO:teuthology.orchestra.run.smithi037.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 5.1 MB/s | 200 kB 00:00 2023-10-06T04:14:06.149 INFO:teuthology.orchestra.run.smithi037.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 3.5 MB/s | 97 kB 00:00 2023-10-06T04:14:06.248 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2023-10-06T04:14:06.248 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2023-10-06T04:14:06.818 INFO:teuthology.orchestra.run.smithi037.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 5.1 MB/s | 3.5 MB 00:00 2023-10-06T04:14:07.142 INFO:teuthology.orchestra.run.smithi037.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 3.6 MB/s | 3.6 MB 00:00 2023-10-06T04:14:08.016 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2023-10-06T04:14:08.021 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2023-10-06T04:14:13.401 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2023-10-06T04:14:13.663 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:14:13.893 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:14:14.010 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T04:14:14.225 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:14:14.594 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T04:14:14.817 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T04:14:15.221 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T04:14:15.884 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T04:14:16.053 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T04:14:16.309 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:14:16.407 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:14:16.630 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T04:14:16.968 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T04:14:17.636 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:14:17.850 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:14:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:14:18.204 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:14:18.365 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:14:18.585 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:14:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:14:18.916 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T04:14:18.955 INFO:teuthology.orchestra.run.smithi037.stdout:(120/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 2.8 MB/s | 52 MB 00:18 2023-10-06T04:14:18.960 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:14:18.960 INFO:teuthology.orchestra.run.smithi037.stdout:Total 6.8 MB/s | 201 MB 00:29 2023-10-06T04:14:18.992 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T04:14:19.020 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-10-06T04:14:19.147 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-10-06T04:14:19.147 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-10-06T04:14:19.221 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T04:14:19.505 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T04:14:19.756 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T04:14:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T04:14:20.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:14:20.190 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T04:14:20.350 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:14:20.895 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-10-06T04:14:20.899 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-10-06T04:14:20.903 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T04:14:21.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:14:21.585 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T04:14:21.775 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:14:22.526 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T04:14:22.828 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T04:14:23.060 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T04:14:23.277 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:14:23.464 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T04:14:23.595 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T04:14:23.883 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T04:14:24.147 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T04:14:24.450 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T04:14:24.708 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:14:25.850 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-10-06T04:14:26.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:14:26.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:14:26.544 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:14:26.705 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:14:26.772 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T04:14:26.951 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:14:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T04:14:27.347 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:14:27.618 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T04:14:28.049 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T04:14:28.164 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T04:14:28.351 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:14:28.505 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:14:28.511 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T04:14:28.810 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T04:14:28.852 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T04:14:28.980 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T04:14:29.088 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:14:29.329 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:14:29.377 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T04:14:29.542 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T04:14:29.754 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T04:14:30.078 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T04:14:30.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:14:30.313 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T04:14:30.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:14:30.480 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T04:14:30.574 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:14:30.718 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T04:14:30.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:14:30.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T04:14:31.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:14:31.115 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:14:31.225 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T04:14:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:14:31.330 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:14:31.407 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T04:14:31.539 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T04:14:31.609 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T04:14:31.612 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T04:14:31.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:14:31.780 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T04:14:31.927 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T04:14:31.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:14:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T04:14:32.166 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:14:32.267 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T04:14:32.384 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:14:32.390 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T04:14:32.590 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T04:14:32.776 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T04:14:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:14:33.096 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T04:14:33.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:14:33.343 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T04:14:33.597 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T04:14:33.707 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:14:33.883 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T04:14:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:14:34.057 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:14:34.251 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:14:34.502 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:14:34.740 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:14:34.787 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:14:34.954 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:14:35.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:14:35.124 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:14:35.267 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:14:35.308 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:14:35.475 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:14:35.499 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:14:35.702 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:14:35.747 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:14:35.949 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:14:36.117 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:14:36.176 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:14:36.287 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:14:36.444 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:14:36.537 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:14:36.649 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T04:14:36.792 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:14:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T04:14:37.020 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:14:37.095 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T04:14:37.335 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:14:37.613 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:14:37.838 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:14:38.104 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:14:38.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:14:38.521 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:14:38.880 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:14:39.142 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:14:39.245 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:14:39.449 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:14:39.570 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:14:39.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:14:39.798 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:14:40.162 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:14:40.452 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:14:40.753 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:14:40.972 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:14:41.197 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:14:41.432 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:14:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:14:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:14:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:14:42.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:14:43.021 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T04:14:43.234 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T04:14:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T04:14:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:14:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:14:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:14:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:14:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:14:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:14:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:14:45.105 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:14:45.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:14:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:14:46.067 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:14:46.307 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:14:46.532 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:14:46.538 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:14:46.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:14:46.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:14:47.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:14:47.232 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:14:47.250 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:14:47.442 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:14:47.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:14:47.861 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:14:47.912 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:14:48.069 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:14:48.272 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T04:14:48.362 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:14:48.365 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T04:14:48.505 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T04:14:48.601 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:14:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:14:49.039 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:14:49.221 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:14:49.450 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:14:49.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:14:49.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:14:50.195 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:14:50.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:14:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:14:51.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:14:51.523 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:14:51.853 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:14:52.141 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:14:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:14:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:14:53.873 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:14:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:14:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:14:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:14:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:14:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:14:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:14:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:14:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:15:01.846 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:15:02.265 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:15:02.885 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T04:15:03.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T04:15:03.280 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T04:15:03.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T04:15:06.499 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /run 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-10-06T04:15:06.500 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:06.894 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T04:15:08.376 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T04:15:08.569 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T04:15:08.791 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T04:15:08.961 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T04:15:09.390 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T04:15:09.551 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T04:15:09.568 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T04:15:12.334 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T04:15:12.551 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T04:15:12.740 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T04:15:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T04:15:13.157 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T04:15:13.372 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T04:15:13.593 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T04:15:14.563 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T04:15:14.751 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T04:15:14.850 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T04:15:15.233 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T04:15:15.426 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T04:15:15.463 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T04:15:15.651 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T04:15:15.661 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T04:15:17.279 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T04:15:17.543 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T04:15:17.634 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T04:15:17.792 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T04:15:17.835 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T04:15:18.025 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T04:15:18.374 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T04:15:18.592 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T04:15:21.964 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-10-06T04:15:21.965 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-06T04:15:21.966 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:22.354 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T04:15:23.514 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T04:15:23.948 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T04:15:24.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T04:15:24.369 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T04:15:24.502 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T04:15:24.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T04:15:24.904 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T04:15:24.985 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T04:15:25.113 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T04:15:25.178 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T04:15:25.196 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T04:15:25.330 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T04:15:25.499 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:15:25.511 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T04:15:25.712 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T04:15:25.862 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:15:26.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T04:15:26.224 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T04:15:26.497 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T04:15:26.699 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:15:26.755 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T04:15:26.957 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:15:26.966 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T04:15:27.076 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T04:15:27.076 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:15:27.319 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:15:27.319 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:28.219 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T04:15:28.220 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T04:15:28.221 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T04:15:28.222 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T04:15:28.230 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:15:28.231 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:15:28.232 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:15:28.233 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T04:15:28.234 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T04:15:28.235 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T04:15:28.236 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T04:15:28.237 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:15:28.238 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T04:15:28.681 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T04:15:28.820 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T04:15:29.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T04:15:29.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T04:15:29.491 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T04:15:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T04:15:29.958 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T04:15:30.482 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:30.482 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:01:50 ago on Fri 06 Oct 2023 04:13:40 AM UTC. 2023-10-06T04:15:30.986 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T04:15:31.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T04:15:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T04:15:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T04:15:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T04:15:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T04:15:32.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T04:15:32.139 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T04:15:32.615 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2023-10-06T04:15:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:32.756 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2023-10-06T04:15:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.758 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:15:32.759 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:15:32.760 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:15:32.761 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.762 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:15:32.763 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:15:32.764 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:15:32.765 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:15:32.766 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:15:32.767 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:15:32.768 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:15:32.768 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:32.768 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-10-06T04:15:33.021 DEBUG:teuthology.parallel:result is None 2023-10-06T04:15:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T04:15:34.141 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T04:15:34.265 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T04:15:34.460 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T04:15:34.506 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T04:15:34.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T04:15:35.026 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T04:15:35.218 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T04:15:40.450 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T04:15:40.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T04:15:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:15:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:15:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:15:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T04:15:42.537 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:15:42.714 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T04:15:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:15:43.026 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T04:15:43.234 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T04:15:43.419 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T04:15:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:15:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:15:43.951 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:15:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:15:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:15:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:15:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:15:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T04:15:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T04:15:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T04:15:45.433 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T04:15:45.434 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T04:15:45.435 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T04:15:45.436 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T04:15:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T04:15:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T04:15:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T04:15:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T04:15:45.444 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:15:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:15:45.445 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:15:45.446 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:15:45.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:15:45.448 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:15:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:15:45.451 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:15:45.452 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:15:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:15:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:15:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T04:15:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:15:45.453 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T04:15:47.842 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:15:47.842 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:08 ago on Fri 06 Oct 2023 04:13:39 AM UTC. 2023-10-06T04:15:52.085 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:15:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:15:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:15:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:15:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:15:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:15:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:15:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:15:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:15:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:15:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:15:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:52.241 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-06T04:15:52.441 DEBUG:teuthology.parallel:result is None 2023-10-06T04:15:52.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T04:15:52.582 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:15:52.604 INFO:teuthology.orchestra.run.smithi037.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T04:15:52.604 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T04:15:52.605 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T04:15:52.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T04:15:52.740 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:15:52.765 INFO:teuthology.orchestra.run.smithi083.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T04:15:52.765 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T04:15:52.765 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T04:15:52.765 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:15:52.766 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:52.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:15:52.806 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:52.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:15:52.848 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:15:52.848 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:52.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:15:52.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:15:52.938 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:52.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:15:52.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:15:53.031 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:15:53.031 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:53.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:15:53.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:15:53.121 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:53.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:15:53.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:15:53.213 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:15:53.213 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:53.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:15:53.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:15:53.302 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:53.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:15:53.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:15:53.392 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:15:53.455 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:15:53.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-10-06T04:15:53.457 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2023-10-06T04:15:53.482 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:15:53.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:15:53.522 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:15:53.546 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:15:53.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:15:53.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:15:53.617 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:15:53.617 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:15:53.617 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:15:53.617 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:53.618 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:15:53.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:15:53.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:15:53.795 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:53.795 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:15:53.810 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:15:53.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:15:53.950 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:15:53.950 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:15:53.950 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412250', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC86wr1epLFbSfu8kXLD/mAFRYoAYEm737l133EOAsPylg5zNKnwXLt8DWx+LiEOROKV1INS76Nhw67lviJRgD8=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7DKOYjzxAnIu5A0szzJ095WnezlykVsQEtF7MrxPlN8VW8MSmRu4CXSgREMecIHe4iXfoDPxKJffjUr19J6mU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:15:53.951 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:15:53.953 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:15:53.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:15:54.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:15:54.063 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:54.063 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:15:54.086 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:15:54.086 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 218571 Links: 1 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:15:44.980017076 +0000 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:12:52.812687674 +0000 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:12:52.812687674 +0000 2023-10-06T04:15:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:15:54.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:15:54.204 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:15:54.205 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:15:54.205 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000346577 s, 1.5 MB/s 2023-10-06T04:15:54.206 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:15:54.262 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 219585 Links: 1 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:54.317 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:15:44.980017076 +0000 2023-10-06T04:15:54.318 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:12:53.346680656 +0000 2023-10-06T04:15:54.318 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:12:53.346680656 +0000 2023-10-06T04:15:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:15:54.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:15:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:15:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:15:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000243959 s, 2.1 MB/s 2023-10-06T04:15:54.382 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:15:54.437 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-10-06T04:15:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:15:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 222240 Links: 1 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:15:44.980017076 +0000 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:12:53.855673967 +0000 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:12:53.855673967 +0000 2023-10-06T04:15:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:15:54.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:15:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:15:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:15:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000209322 s, 2.4 MB/s 2023-10-06T04:15:54.557 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:15:54.613 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-10-06T04:15:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:15:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 220375 Links: 1 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 04:15:44.980017076 +0000 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 04:12:54.364667278 +0000 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 04:12:54.364667278 +0000 2023-10-06T04:15:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T04:15:54.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:15:54.732 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T04:15:54.732 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T04:15:54.732 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000194199 s, 2.6 MB/s 2023-10-06T04:15:54.733 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:15:54.789 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:54.789 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:54.790 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:15:54.807 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:15:54.808 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 216025 Links: 1 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:15:27.802278452 +0000 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:12:31.087045115 +0000 2023-10-06T04:15:54.866 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:12:31.087045115 +0000 2023-10-06T04:15:54.867 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:15:54.867 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:15:54.933 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:15:54.934 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:15:54.934 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000281071 s, 1.8 MB/s 2023-10-06T04:15:54.935 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:15:54.993 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2023-10-06T04:15:55.051 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 219709 Links: 1 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:15:27.802278452 +0000 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:12:31.620032242 +0000 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:12:31.620032242 +0000 2023-10-06T04:15:55.052 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:15:55.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:15:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:15:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:15:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000276323 s, 1.9 MB/s 2023-10-06T04:15:55.119 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:15:55.176 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2023-10-06T04:15:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:15:55.232 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:55.232 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 214853 Links: 1 2023-10-06T04:15:55.232 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:55.232 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:55.233 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:15:27.802278452 +0000 2023-10-06T04:15:55.233 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:12:32.113020336 +0000 2023-10-06T04:15:55.233 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:12:32.113020336 +0000 2023-10-06T04:15:55.233 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:15:55.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:15:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:15:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:15:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.00022253 s, 2.3 MB/s 2023-10-06T04:15:55.297 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:15:55.354 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2023-10-06T04:15:55.410 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 214975 Links: 1 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-10-06 04:15:27.803278428 +0000 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-10-06 04:12:32.811003476 +0000 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-10-06 04:12:32.811003476 +0000 2023-10-06T04:15:55.411 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-10-06T04:15:55.412 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:15:55.475 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-10-06T04:15:55.475 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-10-06T04:15:55.475 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000202109 s, 2.5 MB/s 2023-10-06T04:15:55.476 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:15:55.532 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:55.532 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:15:55.532 INFO:tasks.ceph:Generating config... 2023-10-06T04:15:55.533 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:15:55.533 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:15:55.534 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:15:55.534 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:15:55.534 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:15:55.534 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:15:55.534 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:15:55.534 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:15:55.535 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:15:55.535 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T04:15:55.535 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T04:15:55.535 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T04:15:55.535 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:15:55.536 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:15:55.537 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:15:55.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:15:55.598 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:15:55.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:15:55.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:15:55.709 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2023-10-06T04:15:55.709 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:15:55.710 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:55.710 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:15:55.764 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:15:55.847 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 40813f02-7e3b-4d33-ae21-8c35b4fd9578 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = octopus 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 40813f02-7e3b-4d33-ae21-8c35b4fd9578 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-10-06T04:15:55.847143+0000 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-10-06T04:15:55.847143+0000 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 15 (octopus) 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-10-06T04:15:55.848 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2023-10-06T04:15:55.849 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2023-10-06T04:15:55.849 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:15:55.850 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:15:55.905 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 40813f02-7e3b-4d33-ae21-8c35b4fd9578... 2023-10-06T04:15:55.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:15:55.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:15:55.989 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T04:15:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T04:15:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 40813f02-7e3b-4d33-ae21-8c35b4fd9578 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T04:15:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T04:15:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T04:15:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T04:15:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T04:15:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T04:15:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:15:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T04:15:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T04:15:56.001 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T04:15:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.003 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2023-10-06T04:15:56.004 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:15:56.005 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.006 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.37,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on skipped message = False 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 40813f02-7e3b-4d33-ae21-8c35b4fd9578 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2023-10-06T04:15:56.007 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.008 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2023-10-06T04:15:56.009 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2023-10-06T04:15:56.010 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:15:56.011 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2023-10-06T04:15:56.012 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2023-10-06T04:15:56.013 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2023-10-06T04:15:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2023-10-06T04:15:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-10-06T04:15:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-10-06T04:15:56.017 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:15:56.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:15:56.109 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:15:56.109 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:56.109 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:15:56.124 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:56.125 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:15:56.182 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:15:56.182 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:56.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:15:56.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:15:56.258 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:15:56.258 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:15:56.313 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:15:56.313 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:56.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:15:56.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:15:56.354 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:15:56.354 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:15:56.411 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:15:56.411 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:15:56.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:15:56.460 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:15:56.462 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:15:56.539 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:15:56.542 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:15:56.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:15:56.592 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:15:56.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:15:56.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:15:56.708 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:15:56.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:15:56.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:15:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:15:56.790 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:15:56.815 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:15:56.904 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:15:56.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:15:56.931 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:15:56.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:15:56.971 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:15:56.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:15:57.063 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:15:57.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:15:57.113 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:15:57.126 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:15:57.203 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:15:57.215 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:15:57.215 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:15:57.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:15:57.242 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:57.242 INFO:tasks.ceph:role: osd.0 2023-10-06T04:15:57.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:15:57.242 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:15:57.315 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:15:57.316 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:15:57.316 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:15:57.316 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:15:57.316 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:15:57.752 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T04:15:57.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:15:57.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:15:57.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:15:57.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:15:58.026 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:58.026 INFO:tasks.ceph:role: osd.1 2023-10-06T04:15:58.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:15:58.026 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:15:58.100 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:15:58.100 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:15:58.101 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:15:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T04:15:58.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:15:58.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:15:58.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:15:58.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:15:58.737 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:58.738 INFO:tasks.ceph:role: osd.2 2023-10-06T04:15:58.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:15:58.738 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:15:58.813 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:15:58.814 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:15:58.814 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:15:58.814 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:15:58.814 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:15:59.258 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T04:15:59.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:15:59.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:15:59.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:15:59.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:15:59.536 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:15:59.536 INFO:tasks.ceph:role: osd.3 2023-10-06T04:15:59.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:15:59.536 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:15:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:15:59.613 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:16:00.052 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T04:16:00.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T04:16:00.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:16:00.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:16:00.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.347+0000 7f8967c36540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:16:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.348+0000 7f8967c36540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:16:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.348+0000 7f8967c36540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:16:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.348+0000 7f8967c36540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:16:00.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.348+0000 7f8967c36540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:16:00.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.348+0000 7f8967c36540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:16:00.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:00.875+0000 7f8967c36540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:01.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:01.646+0000 7f8967c36540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:02.409+0000 7f8967c36540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:03.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:16:03.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:03.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.336+0000 7fea47c3e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:16:03.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.337+0000 7fea47c3e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:16:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.337+0000 7fea47c3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:16:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.337+0000 7fea47c3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:16:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.337+0000 7fea47c3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:16:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.337+0000 7fea47c3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:16:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:03.862+0000 7fea47c3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:04.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:04.626+0000 7fea47c3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:05.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:05.387+0000 7fea47c3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:06.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:16:06.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:16:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:16:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:16:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:16:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:16:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.297+0000 7f39e0ed1540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:16:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:06.828+0000 7f39e0ed1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:07.592+0000 7f39e0ed1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:08.353+0000 7f39e0ed1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:09.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:16:09.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:09.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.266+0000 7f7c5f46c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:16:09.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.267+0000 7f7c5f46c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:16:09.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.267+0000 7f7c5f46c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:16:09.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.267+0000 7f7c5f46c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:16:09.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.267+0000 7f7c5f46c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:16:09.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.267+0000 7f7c5f46c540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:16:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:09.792+0000 7f7c5f46c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:10.555+0000 7f7c5f46c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:11.317+0000 7f7c5f46c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:12.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:16:12.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:16:12.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:16:12.170 INFO:tasks.ceph:role: osd.4 2023-10-06T04:16:12.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:16:12.170 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:16:12.243 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:16:12.671 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T04:16:12.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:16:12.672 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:16:12.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:16:12.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:16:12.952 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:16:12.952 INFO:tasks.ceph:role: osd.5 2023-10-06T04:16:12.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:16:12.952 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:16:13.024 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:16:13.025 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:16:13.447 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T04:16:13.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:16:13.448 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:16:13.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:16:13.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:16:13.642 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:16:13.642 INFO:tasks.ceph:role: osd.6 2023-10-06T04:16:13.643 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:16:13.643 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:16:13.715 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:16:13.716 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:16:14.163 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T04:16:14.165 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:16:14.165 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:16:14.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:16:14.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:16:14.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:16:14.399 INFO:tasks.ceph:role: osd.7 2023-10-06T04:16:14.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:16:14.399 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:16:14.471 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:16:14.471 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:16:14.471 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:16:14.471 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 2023-10-06T04:16:14.471 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:16:14.472 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:16:14.472 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:16:14.472 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:16:14.472 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:16:14.472 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:16:14.915 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-10-06T04:16:14.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-10-06T04:16:14.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:16:15.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:16:15.109 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:15.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:16:15.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:16:15.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:16:15.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:16:15.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:16:15.208 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.206+0000 7fe840b08540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:16:15.735 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:15.734+0000 7fe840b08540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:16.508 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:16.507+0000 7fe840b08540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:17.274 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:17.273+0000 7fe840b08540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:18.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:16:18.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:18.184 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:16:18.184 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:16:18.185 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:16:18.185 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:16:18.185 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:16:18.185 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.183+0000 7fa512cec540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:16:18.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:18.706+0000 7fa512cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:19.473 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:19.472+0000 7fa512cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:20.236 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:20.235+0000 7fa512cec540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:21.033 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:16:21.060 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.140+0000 7eff290e1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.140+0000 7eff290e1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.140+0000 7eff290e1540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.140+0000 7eff290e1540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.140+0000 7eff290e1540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:16:21.143 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.141+0000 7eff290e1540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:16:21.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:21.665+0000 7eff290e1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:22.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:22.429+0000 7eff290e1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:23.193 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:23.191+0000 7eff290e1540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:23.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:16:23.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:16:24.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:16:24.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.103+0000 7fb6e6dd9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.103+0000 7fb6e6dd9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.103+0000 7fb6e6dd9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.103+0000 7fb6e6dd9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.103+0000 7fb6e6dd9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:16:24.106 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.104+0000 7fb6e6dd9540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:16:24.635 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:24.633+0000 7fb6e6dd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:25.402 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:25.400+0000 7fb6e6dd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:26.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:26.165+0000 7fb6e6dd9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:16:26.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:16:27.034 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:16:27.035 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:16:27.062 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:16:27.129 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:16:27.195 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:16:27.261 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:16:27.327 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:16:27.392 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:16:27.458 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:16:27.486 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.487 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:16:27.553 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:16:27.620 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.620 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:16:27.686 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:16:27.752 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.752 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:16:27.816 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:16:27.881 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.882 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:16:27.897 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:27.897 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:16:27.953 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.953 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:16:27.967 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:27.968 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:16:28.022 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:16:28.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:16:28.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:16:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-10-06T04:16:28.066 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9lO+ZrGxAARweKKWos8HgplukaFq0OCg== 2023-10-06T04:16:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T04:16:28.066 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9l7plJIxAAjtEY/eMqVjslOoPX4Xs1zA== 2023-10-06T04:16:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9lXsI5KhAAyyJae0HGzGnhZszmDxKF3w== 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAAih9ldxvVFBAAfAw0SNPQ+HA5BxVAIlcPzg== 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQADih9litYvFBAAxYWBkScFV7XPcaZp6QAmuw== 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAGih9l64PQERAA3EdOYArRTD1EWdmkju4kyg== 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAJih9lKWHyDxAAlAhQGA0z+Go4kqEu7nWvBQ== 2023-10-06T04:16:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9lTK8gIBAA0xWRZV/ucHmwUqm24fRjDw== 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9ltY33LhAAD5Irr+67DDXOlmfiLm0Ieg== 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9lpOHfNRAAfktrc51i5A0ftu/+gQtMMg== 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAPih9lVf5RDBAATmmA0FAajS81QJWJjQGA1g== 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQASih9lvULwChAA0ai1lp1GQsi1rIkHW+7q4A== 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-10-06T04:16:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAVih9lMVx3CBAAcyCl/HpHbi0FfJhTTIS2UQ== 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYih9lulhDBhAAnq4CSvxD0VVmfuZJPyECZw== 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9lVhPYORAAwQoJ3qfOUOVh00MPW5mYYA== 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9iR9lqpbAAxAAG2NvuMWXhzOPIqt2GC5xLw== 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9iR9lOX+9BhAAZBMcVzDbo26oYQ0LNKy/3Q== 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-10-06T04:16:28.069 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD9iR9lAMMXDBAA2kc2FjYOw5nsUcZlGwvMnw== 2023-10-06T04:16:28.085 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2023-10-06T04:16:28.085 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9lO+ZrGxAARweKKWos8HgplukaFq0OCg== 2023-10-06T04:16:28.085 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9l7plJIxAAjtEY/eMqVjslOoPX4Xs1zA== 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9lXsI5KhAAyyJae0HGzGnhZszmDxKF3w== 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAAih9ldxvVFBAAfAw0SNPQ+HA5BxVAIlcPzg== 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQADih9litYvFBAAxYWBkScFV7XPcaZp6QAmuw== 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAGih9l64PQERAA3EdOYArRTD1EWdmkju4kyg== 2023-10-06T04:16:28.086 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAJih9lKWHyDxAAlAhQGA0z+Go4kqEu7nWvBQ== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9lTK8gIBAA0xWRZV/ucHmwUqm24fRjDw== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9ltY33LhAAD5Irr+67DDXOlmfiLm0Ieg== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9lpOHfNRAAfktrc51i5A0ftu/+gQtMMg== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAPih9lVf5RDBAATmmA0FAajS81QJWJjQGA1g== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQASih9lvULwChAA0ai1lp1GQsi1rIkHW+7q4A== 2023-10-06T04:16:28.087 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAVih9lMVx3CBAAcyCl/HpHbi0FfJhTTIS2UQ== 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAYih9lulhDBhAAnq4CSvxD0VVmfuZJPyECZw== 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD8iR9lVhPYORAAwQoJ3qfOUOVh00MPW5mYYA== 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD9iR9lqpbAAxAAG2NvuMWXhzOPIqt2GC5xLw== 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD9iR9lOX+9BhAAZBMcVzDbo26oYQ0LNKy/3Q== 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2023-10-06T04:16:28.088 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQD9iR9lAMMXDBAA2kc2FjYOw5nsUcZlGwvMnw== 2023-10-06T04:16:28.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:16:28.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:16:28.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.179 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.231 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:16:28.481 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:16:28.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.582 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:16:28.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.635 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.684 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.733 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:16:28.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.832 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.885 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:28.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:16:29.039 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:16:29.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:16:29.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:16:29.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:16:29.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:16:29.205 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:16:29.297 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:16:29.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:16:29.386 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:16:29.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:16:29.501 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:29.504 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:16:29.556 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:16:29.556 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:16:29.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:16:29.559 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:16:29.559 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:16:29.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:16:29.598 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:16:29.598 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:16:29.598 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:16:29.600 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:16:29.600 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:16:29.600 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:16:29.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:16:29.602 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:16:29.603 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:16:29.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:16:29.604 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:16:29.605 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:16:29.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:16:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.723+0000 7fb056d60700 1 Processor -- start 2023-10-06T04:16:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.723+0000 7fb056d60700 1 -- start start 2023-10-06T04:16:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500ccd70 con 0x7fb0501598d0 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05015d6b0 con 0x7fb0500cde20 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb056d60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05015d990 con 0x7fb05015e360 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57162/0 (socket says 172.21.15.37:57162) 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 learned_addr learned my addr 172.21.15.37:0/2272844208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 msgr2=0x7fb0500b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 msgr2=0x7fb0500b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb04ffff700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 msgr2=0x7fb05015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb04ffff700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 msgr2=0x7fb05015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb0552fd700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 msgr2=0x7fb0500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb0552fd700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 msgr2=0x7fb0500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:16:29.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.724+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:16:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 msgr2=0x7fb0500b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:16:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 msgr2=0x7fb0500b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb04ffff700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 msgr2=0x7fb05015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb04ffff700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 msgr2=0x7fb05015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb0552fd700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 msgr2=0x7fb0500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb0552fd700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 msgr2=0x7fb0500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:16:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:29.925+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:16:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.37:3300/0 conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb0552fd700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 msgr2=0x7fb0500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 msgr2=0x7fb05015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 -- 172.21.15.37:0/2272844208 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500b0170 con 0x7fb0501598d0 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb04ffff700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb054afc700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0501598d0 0x7fb0500b0bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb05006e5e0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b6db0decf3d606 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.326+0000 7fb04f7fe700 1 -- 172.21.15.37:0/2272844208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040010710 con 0x7fb0501598d0 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb04f7fe700 1 -- 172.21.15.37:0/2272844208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000c050 con 0x7fb0501598d0 2023-10-06T04:16:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb04f7fe700 1 -- 172.21.15.37:0/2272844208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040010ae0 con 0x7fb0501598d0 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 -- 172.21.15.37:0/2272844208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0501598d0 msgr2=0x7fb0500b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0501598d0 0x7fb0500b0bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb05006e5e0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 -- 172.21.15.37:0/2272844208 shutdown_connections 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb05015e360 0x7fb0500aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 --2- 172.21.15.37:0/2272844208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0501598d0 0x7fb0500b0bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 --2- 172.21.15.37:0/2272844208 >> v2:172.21.15.83:3300/0 conn(0x7fb0500cde20 0x7fb05015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 -- 172.21.15.37:0/2272844208 >> 172.21.15.37:0/2272844208 conn(0x7fb050068770 msgr2=0x7fb050068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 -- 172.21.15.37:0/2272844208 shutdown_connections 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.327+0000 7fb056d60700 1 -- 172.21.15.37:0/2272844208 wait complete. 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.328+0000 7fb056d60700 1 Processor -- start 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 -- start start 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0500cde20 0x7fb05014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 0x7fb0500b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05014d720 con 0x7fb05015e360 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050169ed0 con 0x7fb0501598d0 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb056d60700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050152f20 con 0x7fb0500cde20 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb0552fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb054afc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0500cde20 0x7fb05014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.329+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 0x7fb0500b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb0552fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57230/0 (socket says 172.21.15.37:57230) 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb0552fd700 1 -- 172.21.15.37:0/3331441171 learned_addr learned my addr 172.21.15.37:0/3331441171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 -- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0500cde20 msgr2=0x7fb05014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0500cde20 0x7fb05014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 -- 172.21.15.37:0/3331441171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 msgr2=0x7fb0500b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 -- 172.21.15.37:0/3331441171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04400e040 con 0x7fb0501598d0 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb0552fd700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04ffff700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 0x7fb0500b2800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0440129d0 tx=0x7fb044008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440146c0 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044014820 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04000e5d0 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044014bc0 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0501534e0 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb044015450 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.330+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb04401e410 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.331+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05004c3c0 con 0x7fb0501598d0 2023-10-06T04:16:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.333+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb044019030 con 0x7fb0501598d0 2023-10-06T04:16:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.410+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb05016a010 con 0x7fb0501598d0 2023-10-06T04:16:30.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.418+0000 7fb04cff9700 1 -- 172.21.15.37:0/3331441171 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb044015aa0 con 0x7fb0501598d0 2023-10-06T04:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 msgr2=0x7fb0500b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 0x7fb0500b2800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0440129d0 tx=0x7fb044008040 comp rx=0 tx=0).stop 2023-10-06T04:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 shutdown_connections 2023-10-06T04:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb05015e360 0x7fb0500b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0500cde20 0x7fb05014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 --2- 172.21.15.37:0/3331441171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0501598d0 0x7fb0500b2800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 >> 172.21.15.37:0/3331441171 conn(0x7fb050068770 msgr2=0x7fb050068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 shutdown_connections 2023-10-06T04:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:30.419+0000 7fb056d60700 1 -- 172.21.15.37:0/3331441171 wait complete. 2023-10-06T04:16:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-10-06T04:16:30.432 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:16:30.432 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:30.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:16:30.457 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:30.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:16:30.523 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:30.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:16:30.588 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:16:30.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:16:30.653 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:30.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:16:30.678 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:30.678 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:16:30.742 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:30.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:16:30.806 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-10-06T04:16:30.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:16:30.871 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 15975640-5e97-4fdf-bb02-0655d8c0403b 0 2023-10-06T04:16:31.028 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.026+0000 7fe3d7f65700 1 Processor -- start 2023-10-06T04:16:31.028 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.026+0000 7fe3d7f65700 1 -- start start 2023-10-06T04:16:31.030 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d7f65700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 0x7fe3d0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.030 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d7f65700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.030 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d7f65700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d015d680 con 0x7fe3d00c8ab0 2023-10-06T04:16:31.030 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d7f65700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00cabe0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d7f65700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d015a5a0 con 0x7fe3d00cca90 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46500/0 (socket says 172.21.15.83:46500) 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 -- 172.21.15.83:0/46559366 learned_addr learned my addr 172.21.15.83:0/46559366 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5d01700 1 --2- 172.21.15.83:0/46559366 >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 0x7fe3d0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 -- 172.21.15.83:0/46559366 >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 msgr2=0x7fe3d0159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 --2- 172.21.15.83:0/46559366 >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 0x7fe3d0159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 -- 172.21.15.83:0/46559366 >> v1:172.21.15.37:6789/0 conn(0x7fe3d00c8ab0 legacy=0x7fe3d015db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 -- 172.21.15.83:0/46559366 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d015a880 con 0x7fe3d00cca90 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5d01700 1 --2- 172.21.15.83:0/46559366 >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 0x7fe3d0159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d5500700 1 --2- 172.21.15.83:0/46559366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0099b0 tx=0x7fe3cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f08040e5266623d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.031 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d4cff700 1 -- 172.21.15.83:0/46559366 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc009ea0 con 0x7fe3d00cca90 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d4cff700 1 -- 172.21.15.83:0/46559366 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00b860 con 0x7fe3d00cca90 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.027+0000 7fe3d4cff700 1 -- 172.21.15.83:0/46559366 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00bc00 con 0x7fe3d00cca90 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 -- 172.21.15.83:0/46559366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 msgr2=0x7fe3d00ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/46559366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0099b0 tx=0x7fe3cc009250 comp rx=0 tx=0).stop 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 -- 172.21.15.83:0/46559366 shutdown_connections 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/46559366 >> v2:172.21.15.37:3300/0 conn(0x7fe3d00cc6c0 0x7fe3d0159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/46559366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cca90 0x7fe3d00ca6a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 -- 172.21.15.83:0/46559366 >> 172.21.15.83:0/46559366 conn(0x7fe3d00ce470 msgr2=0x7fe3d00ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 -- 172.21.15.83:0/46559366 shutdown_connections 2023-10-06T04:16:31.032 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.028+0000 7fe3d7f65700 1 -- 172.21.15.83:0/46559366 wait complete. 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.029+0000 7fe3d7f65700 1 Processor -- start 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.029+0000 7fe3d7f65700 1 -- start start 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3d00c8ab0 0x7fe3d00b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00cca90 0x7fe3d016da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d015cbf0 con 0x7fe3d00cca90 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c78c0 con 0x7fe3d00c8ab0 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d7f65700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00b1ff0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46510/0 (socket says 172.21.15.83:46510) 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 -- 172.21.15.83:0/2607033437 learned_addr learned my addr 172.21.15.83:0/2607033437 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d6502700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00cca90 0x7fe3d016da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 -- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3d00c8ab0 msgr2=0x7fe3d00b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3d00c8ab0 0x7fe3d00b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 -- 172.21.15.83:0/2607033437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00cca90 msgr2=0x7fe3d016da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00cca90 0x7fe3d016da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 -- 172.21.15.83:0/2607033437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00093c0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.030+0000 7fe3d5500700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe3d015a6e0 tx=0x7fe3cc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00bbe0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc011420 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0117c0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc0094f0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d016dfc0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe3cc02e3f0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.031+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe3cc025740 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.032+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d015ae30 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.038 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.034+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe3d015ae30 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.107 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.105+0000 7f12c98fa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:16:31.118 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.116+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15975640-5e97-4fdf-bb02-0655d8c0403b", "id": 0} v 0) v1 -- 0x7fe3d004c3c0 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.127 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.124+0000 7fe3c5ffb700 1 -- 172.21.15.83:0/2607033437 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15975640-5e97-4fdf-bb02-0655d8c0403b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe3cc033060 con 0x7fe3d00cc6c0 2023-10-06T04:16:31.127 INFO:teuthology.orchestra.run.smithi083.stdout:0 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 msgr2=0x7fe3d0156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe3d015a6e0 tx=0x7fe3cc017000 comp rx=0 tx=0).stop 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 shutdown_connections 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00cca90 0x7fe3d016da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3d00c8ab0 0x7fe3d00b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 --2- 172.21.15.83:0/2607033437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3d00cc6c0 0x7fe3d0156330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 >> 172.21.15.83:0/2607033437 conn(0x7fe3d00ce470 msgr2=0x7fe3d0159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.128 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 shutdown_connections 2023-10-06T04:16:31.129 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.126+0000 7fe3d7f65700 1 -- 172.21.15.83:0/2607033437 wait complete. 2023-10-06T04:16:31.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 6eb4e93d-fa22-4795-9fad-7f819f02c729 1 2023-10-06T04:16:31.175 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.174+0000 7f2215240180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:16:31.246 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.244+0000 7f12c98fa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:16:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.253+0000 7fbef8462700 1 Processor -- start 2023-10-06T04:16:31.255 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.253+0000 7fbef8462700 1 -- start start 2023-10-06T04:16:31.257 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef8462700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbef015dde0 0x7fbef00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef8462700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef00ce170 con 0x7fbef0150890 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef8462700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef00cb890 con 0x7fbef0150c60 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef8462700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00cbb70 con 0x7fbef015dde0 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbef015dde0 0x7fbef00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbef015dde0 0x7fbef00ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35564/0 (socket says 172.21.15.83:35564) 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 -- 172.21.15.83:0/226465881 learned_addr learned my addr 172.21.15.83:0/226465881 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 -- 172.21.15.83:0/226465881 >> v1:172.21.15.83:6789/0 conn(0x7fbef0150c60 legacy=0x7fbef015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 -- 172.21.15.83:0/226465881 >> v1:172.21.15.37:6789/0 conn(0x7fbef0150890 legacy=0x7fbef00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.254+0000 7fbef69ff700 1 -- 172.21.15.83:0/226465881 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00cbe50 con 0x7fbef015dde0 2023-10-06T04:16:31.258 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef69ff700 1 --2- 172.21.15.83:0/226465881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00ce600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009f20 tx=0x7fbee8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8fa02f007d1c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef51fc700 1 -- 172.21.15.83:0/226465881 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800e070 con 0x7fbef015dde0 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef51fc700 1 -- 172.21.15.83:0/226465881 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800ba80 con 0x7fbef015dde0 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef51fc700 1 -- 172.21.15.83:0/226465881 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80092e0 con 0x7fbef015dde0 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 -- 172.21.15.83:0/226465881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 msgr2=0x7fbef00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 --2- 172.21.15.83:0/226465881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00ce600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009f20 tx=0x7fbee8009840 comp rx=0 tx=0).stop 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 -- 172.21.15.83:0/226465881 shutdown_connections 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 --2- 172.21.15.83:0/226465881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00ce600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 -- 172.21.15.83:0/226465881 >> 172.21.15.83:0/226465881 conn(0x7fbef0099a30 msgr2=0x7fbef006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 -- 172.21.15.83:0/226465881 shutdown_connections 2023-10-06T04:16:31.259 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.255+0000 7fbef8462700 1 -- 172.21.15.83:0/226465881 wait complete. 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 Processor -- start 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 -- start start 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbef0150890 0x7fbef00ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef0150c60 0x7fbef00c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c65f0 con 0x7fbef0150c60 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c68d0 con 0x7fbef015dde0 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef8462700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c6bb0 con 0x7fbef0150890 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef69ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef69ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35568/0 (socket says 172.21.15.83:35568) 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef69ff700 1 -- 172.21.15.83:0/431988763 learned_addr learned my addr 172.21.15.83:0/431988763 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef61fe700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbef0150890 0x7fbef00ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.257+0000 7fbef59fd700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef0150c60 0x7fbef00c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 -- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbef0150890 msgr2=0x7fbef00ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbef0150890 0x7fbef00ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 -- 172.21.15.83:0/431988763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef0150c60 msgr2=0x7fbef00c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef0150c60 0x7fbef00c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 -- 172.21.15.83:0/431988763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8009ae0 con 0x7fbef015dde0 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef69ff700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbee8012000 tx=0x7fbee8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80094e0 con 0x7fbef015dde0 2023-10-06T04:16:31.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8008ce0 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80256b0 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00c6e90 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef014eeb0 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbee8003040 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.258+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fbee801c7d0 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.259+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef004c3c0 con 0x7fbef015dde0 2023-10-06T04:16:31.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.261+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbee802a020 con 0x7fbef015dde0 2023-10-06T04:16:31.313 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.311+0000 7f2215240180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:16:31.324 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.322+0000 7f12c98fa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:16:31.346 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.343+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6eb4e93d-fa22-4795-9fad-7f819f02c729", "id": 1} v 0) v1 -- 0x7fbef00c7410 con 0x7fbef015dde0 2023-10-06T04:16:31.353 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.351+0000 7fbee27fc700 1 -- 172.21.15.83:0/431988763 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eb4e93d-fa22-4795-9fad-7f819f02c729", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbee8020070 con 0x7fbef015dde0 2023-10-06T04:16:31.354 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 msgr2=0x7fbef00c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbee8012000 tx=0x7fbee8018000 comp rx=0 tx=0).stop 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 shutdown_connections 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef015dde0 0x7fbef00c5f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbef0150890 0x7fbef00ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.355 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 --2- 172.21.15.83:0/431988763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef0150c60 0x7fbef00c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.356 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 >> 172.21.15.83:0/431988763 conn(0x7fbef0099a30 msgr2=0x7fbef0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.356 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.352+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 shutdown_connections 2023-10-06T04:16:31.356 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.353+0000 7fbef8462700 1 -- 172.21.15.83:0/431988763 wait complete. 2023-10-06T04:16:31.367 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 812a09ba-e1f2-4dd2-b3c1-570c77a5e35a 2 2023-10-06T04:16:31.391 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.390+0000 7f2215240180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:16:31.483 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.481+0000 7f8adf2c5700 1 Processor -- start 2023-10-06T04:16:31.483 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.481+0000 7f8adf2c5700 1 -- start start 2023-10-06T04:16:31.485 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8adf2c5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ad80cd0e0 0x7f8ad80cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.485 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8adf2c5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ad80cb4b0 0x7f8ad80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.485 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8adf2c5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80b0ab0 con 0x7f8ad80cd4b0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8adf2c5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80cdd80 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8adf2c5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80cb050 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ad80cb4b0 0x7f8ad80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8ad80cb4b0 0x7f8ad80ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35582/0 (socket says 172.21.15.83:35582) 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 -- 172.21.15.83:0/969527265 learned_addr learned my addr 172.21.15.83:0/969527265 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8ade2c3700 1 --2- 172.21.15.83:0/969527265 >> v2:172.21.15.37:3300/0 conn(0x7f8ad80cd0e0 0x7f8ad80cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 -- 172.21.15.83:0/969527265 >> v2:172.21.15.37:3300/0 conn(0x7f8ad80cd0e0 msgr2=0x7f8ad80cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 --2- 172.21.15.83:0/969527265 >> v2:172.21.15.37:3300/0 conn(0x7f8ad80cd0e0 0x7f8ad80cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 -- 172.21.15.83:0/969527265 >> v1:172.21.15.37:6789/0 conn(0x7f8ad80cd4b0 legacy=0x7f8ad80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 -- 172.21.15.83:0/969527265 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80b0d90 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.486 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.482+0000 7f8addac2700 1 --2- 172.21.15.83:0/969527265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cb4b0 0x7f8ad80ce790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80898e0 tx=0x7f8ac8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26543b112e937087 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8add2c1700 1 -- 172.21.15.83:0/969527265 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8009e70 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8add2c1700 1 -- 172.21.15.83:0/969527265 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac800b860 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8add2c1700 1 -- 172.21.15.83:0/969527265 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800bc00 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 -- 172.21.15.83:0/969527265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cb4b0 msgr2=0x7f8ad80ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/969527265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cb4b0 0x7f8ad80ce790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80898e0 tx=0x7f8ac8009250 comp rx=0 tx=0).stop 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 -- 172.21.15.83:0/969527265 shutdown_connections 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/969527265 >> v2:172.21.15.37:3300/0 conn(0x7f8ad80cd0e0 0x7f8ad80cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/969527265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cb4b0 0x7f8ad80ce790 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 -- 172.21.15.83:0/969527265 >> 172.21.15.83:0/969527265 conn(0x7f8ad80686c0 msgr2=0x7f8ad8068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 -- 172.21.15.83:0/969527265 shutdown_connections 2023-10-06T04:16:31.487 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.483+0000 7f8adf2c5700 1 -- 172.21.15.83:0/969527265 wait complete. 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.484+0000 7f8adf2c5700 1 Processor -- start 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.484+0000 7f8adf2c5700 1 -- start start 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad80cd4b0 0x7f8ad80cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad816d970 con 0x7f8ad80cd4b0 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad816dc50 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adf2c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad816df30 con 0x7f8ad80cb4b0 2023-10-06T04:16:31.490 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8ade2c3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8ade2c3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46536/0 (socket says 172.21.15.83:46536) 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35586/0 (socket says 172.21.15.83:35586) 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8ade2c3700 1 -- 172.21.15.83:0/2010009737 learned_addr learned my addr 172.21.15.83:0/2010009737 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8adeac4700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad80cd4b0 0x7f8ad80cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 -- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 msgr2=0x7f8ad80c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 -- 172.21.15.83:0/2010009737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad80cd4b0 msgr2=0x7f8ad80cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad80cd4b0 0x7f8ad80cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8addac2700 1 -- 172.21.15.83:0/2010009737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80094f0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.485+0000 7f8ade2c3700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8addac2700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8016000 tx=0x7f8ac8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800bbe0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8000c90 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad815d840 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011650 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad815d460 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8ac8011cc0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.486+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f8ac8025820 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.492 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.487+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad815d6b0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.493 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.489+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8ac8015020 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.518 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.515+0000 7f12c98fa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:16:31.574 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.572+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "812a09ba-e1f2-4dd2-b3c1-570c77a5e35a", "id": 2} v 0) v1 -- 0x7f8ad804c3c0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.578 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8ace7fc700 1 -- 172.21.15.83:0/2010009737 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "812a09ba-e1f2-4dd2-b3c1-570c77a5e35a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ac80253f0 con 0x7f8ad80cd0e0 2023-10-06T04:16:31.579 INFO:teuthology.orchestra.run.smithi083.stdout:2 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 msgr2=0x7f8ad816d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8016000 tx=0x7f8ac8017000 comp rx=0 tx=0).stop 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 shutdown_connections 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad80cd4b0 0x7f8ad80cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ad80cb4b0 0x7f8ad80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 --2- 172.21.15.83:0/2010009737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ad80cd0e0 0x7f8ad816d120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.577+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 >> 172.21.15.83:0/2010009737 conn(0x7f8ad80686c0 msgr2=0x7f8ad80b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.578+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 shutdown_connections 2023-10-06T04:16:31.580 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.578+0000 7f8adf2c5700 1 -- 172.21.15.83:0/2010009737 wait complete. 2023-10-06T04:16:31.583 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.582+0000 7f2215240180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:16:31.591 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 7960843c-4d66-4343-bf35-28d637649874 3 2023-10-06T04:16:31.698 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.696+0000 7f12c98fa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:16:31.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.705+0000 7fc179c70700 1 Processor -- start 2023-10-06T04:16:31.707 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.705+0000 7fc179c70700 1 -- start start 2023-10-06T04:16:31.709 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc179c70700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc174150890 0x7fc1740cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.709 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc179c70700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc174150c60 0x7fc17415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.709 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc179c70700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740ce170 con 0x7fc17415dc10 2023-10-06T04:16:31.709 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc179c70700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17415e030 con 0x7fc174150c60 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc179c70700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740cb890 con 0x7fc174150890 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc174150890 0x7fc1740cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc174150890 0x7fc1740cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35596/0 (socket says 172.21.15.83:35596) 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 -- 172.21.15.83:0/2345192695 learned_addr learned my addr 172.21.15.83:0/2345192695 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc16affd700 1 --2- 172.21.15.83:0/2345192695 >> v2:172.21.15.37:3300/0 conn(0x7fc174150c60 0x7fc17415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 -- 172.21.15.83:0/2345192695 >> v2:172.21.15.37:3300/0 conn(0x7fc174150c60 msgr2=0x7fc17415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 --2- 172.21.15.83:0/2345192695 >> v2:172.21.15.37:3300/0 conn(0x7fc174150c60 0x7fc17415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 -- 172.21.15.83:0/2345192695 >> v1:172.21.15.37:6789/0 conn(0x7fc17415dc10 legacy=0x7fc17415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 -- 172.21.15.83:0/2345192695 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740cbb70 con 0x7fc174150890 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc1737fe700 1 --2- 172.21.15.83:0/2345192695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740cafb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc1740893f0 tx=0x7fc164009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b540dcd4968c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.710 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.706+0000 7fc172ffd700 1 -- 172.21.15.83:0/2345192695 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164005c10 con 0x7fc174150890 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc172ffd700 1 -- 172.21.15.83:0/2345192695 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164005d70 con 0x7fc174150890 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc172ffd700 1 -- 172.21.15.83:0/2345192695 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164006260 con 0x7fc174150890 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 -- 172.21.15.83:0/2345192695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 msgr2=0x7fc1740cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 --2- 172.21.15.83:0/2345192695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740cafb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc1740893f0 tx=0x7fc164009220 comp rx=0 tx=0).stop 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 -- 172.21.15.83:0/2345192695 shutdown_connections 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 --2- 172.21.15.83:0/2345192695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740cafb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 --2- 172.21.15.83:0/2345192695 >> v2:172.21.15.37:3300/0 conn(0x7fc174150c60 0x7fc17415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 -- 172.21.15.83:0/2345192695 >> 172.21.15.83:0/2345192695 conn(0x7fc174099a30 msgr2=0x7fc17406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 -- 172.21.15.83:0/2345192695 shutdown_connections 2023-10-06T04:16:31.711 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.707+0000 7fc179c70700 1 -- 172.21.15.83:0/2345192695 wait complete. 2023-10-06T04:16:31.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.708+0000 7fc179c70700 1 Processor -- start 2023-10-06T04:16:31.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.708+0000 7fc179c70700 1 -- start start 2023-10-06T04:16:31.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.713 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc174150c60 0x7fc1740b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc17415dc10 0x7fc174069890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b5980 con 0x7fc174150c60 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740c76f0 con 0x7fc174150890 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc179c70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17416b010 con 0x7fc17415dc10 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35598/0 (socket says 172.21.15.83:35598) 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc1737fe700 1 -- 172.21.15.83:0/3394814009 learned_addr learned my addr 172.21.15.83:0/3394814009 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc173fff700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc17415dc10 0x7fc174069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.709+0000 7fc16affd700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc174150c60 0x7fc1740b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.714 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 -- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc17415dc10 msgr2=0x7fc174069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc17415dc10 0x7fc174069890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 -- 172.21.15.83:0/3394814009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc174150c60 msgr2=0x7fc1740b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc174150c60 0x7fc1740b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 -- 172.21.15.83:0/3394814009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009480 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc1737fe700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc164006360 tx=0x7fc164016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400b8d0 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400ba30 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400bdf0 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17416b2f0 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.710+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740b4920 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.711+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc16401b8c0 con 0x7fc174150890 2023-10-06T04:16:31.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.711+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fc1640118c0 con 0x7fc174150890 2023-10-06T04:16:31.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.711+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740c7bd0 con 0x7fc174150890 2023-10-06T04:16:31.716 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.713+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc1640446d0 con 0x7fc174150890 2023-10-06T04:16:31.764 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.762+0000 7f2215240180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:16:31.778 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.776+0000 7f12c98fa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:16:31.798 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.796+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7960843c-4d66-4343-bf35-28d637649874", "id": 3} v 0) v1 -- 0x7fc17404c3c0 con 0x7fc174150890 2023-10-06T04:16:31.802 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.801+0000 7fc16bfff700 1 -- 172.21.15.83:0/3394814009 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7960843c-4d66-4343-bf35-28d637649874", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc164033030 con 0x7fc174150890 2023-10-06T04:16:31.803 INFO:teuthology.orchestra.run.smithi083.stdout:3 2023-10-06T04:16:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 msgr2=0x7fc1740b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc164006360 tx=0x7fc164016000 comp rx=0 tx=0).stop 2023-10-06T04:16:31.804 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 shutdown_connections 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc17415dc10 0x7fc174069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc174150890 0x7fc1740b5440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 --2- 172.21.15.83:0/3394814009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc174150c60 0x7fc1740b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 >> 172.21.15.83:0/3394814009 conn(0x7fc174099a30 msgr2=0x7fc1740cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 shutdown_connections 2023-10-06T04:16:31.805 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.802+0000 7fc179c70700 1 -- 172.21.15.83:0/3394814009 wait complete. 2023-10-06T04:16:31.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new efc6b257-4e05-4b54-81d7-10aec757d2d3 4 2023-10-06T04:16:31.845 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.843+0000 7f2215240180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:16:31.921 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:31.917+0000 7f12c98fa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:16:31.935 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.932+0000 7f931eaca700 1 Processor -- start 2023-10-06T04:16:31.935 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 -- start start 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93180cc6e0 0x7f93180b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f931815dc00 0x7f931815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93180aede0 con 0x7f93180ccab0 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9318159ef0 con 0x7f93180cc6e0 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931eaca700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931815d7b0 con 0x7f931815dc00 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.933+0000 7f931d067700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f931815dc00 0x7f931815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f931815dc00 0x7f931815e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35614/0 (socket says 172.21.15.83:35614) 2023-10-06T04:16:31.937 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 -- 172.21.15.83:0/2900982689 learned_addr learned my addr 172.21.15.83:0/2900982689 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931c866700 1 --2- 172.21.15.83:0/2900982689 >> v2:172.21.15.37:3300/0 conn(0x7f93180cc6e0 0x7f93180b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 -- 172.21.15.83:0/2900982689 >> v2:172.21.15.37:3300/0 conn(0x7f93180cc6e0 msgr2=0x7f93180b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 --2- 172.21.15.83:0/2900982689 >> v2:172.21.15.37:3300/0 conn(0x7f93180cc6e0 0x7f93180b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 -- 172.21.15.83:0/2900982689 >> v1:172.21.15.37:6789/0 conn(0x7f93180ccab0 legacy=0x7f931806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 -- 172.21.15.83:0/2900982689 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180af0c0 con 0x7f931815dc00 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f931d067700 1 --2- 172.21.15.83:0/2900982689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f931815e060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f931815d720 tx=0x7f9310009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e32fe7b52ff994 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f93177fe700 1 -- 172.21.15.83:0/2900982689 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000e070 con 0x7f931815dc00 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f93177fe700 1 -- 172.21.15.83:0/2900982689 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000ba20 con 0x7f931815dc00 2023-10-06T04:16:31.938 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.934+0000 7f93177fe700 1 -- 172.21.15.83:0/2900982689 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100092e0 con 0x7f931815dc00 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 -- 172.21.15.83:0/2900982689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 msgr2=0x7f931815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 --2- 172.21.15.83:0/2900982689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f931815e060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f931815d720 tx=0x7f9310009840 comp rx=0 tx=0).stop 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 -- 172.21.15.83:0/2900982689 shutdown_connections 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 --2- 172.21.15.83:0/2900982689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f931815e060 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 --2- 172.21.15.83:0/2900982689 >> v2:172.21.15.37:3300/0 conn(0x7f93180cc6e0 0x7f93180b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 -- 172.21.15.83:0/2900982689 >> 172.21.15.83:0/2900982689 conn(0x7f9318068770 msgr2=0x7f9318068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 -- 172.21.15.83:0/2900982689 shutdown_connections 2023-10-06T04:16:31.939 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.935+0000 7f931eaca700 1 -- 172.21.15.83:0/2900982689 wait complete. 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.936+0000 7f931eaca700 1 Processor -- start 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.936+0000 7f931eaca700 1 -- start start 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93180cc6e0 0x7f9318145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93180ccab0 0x7f931816cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931816d4d0 con 0x7f93180cc6e0 2023-10-06T04:16:31.942 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931815a030 con 0x7f931815dc00 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931815a310 con 0x7f93180ccab0 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35628/0 (socket says 172.21.15.83:35628) 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 -- 172.21.15.83:0/3718114934 learned_addr learned my addr 172.21.15.83:0/3718114934 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f9317fff700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93180ccab0 0x7f931816cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931c866700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93180cc6e0 0x7f9318145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 -- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93180ccab0 msgr2=0x7f931816cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93180ccab0 0x7f931816cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 -- 172.21.15.83:0/3718114934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93180cc6e0 msgr2=0x7f9318145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:31.943 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93180cc6e0 0x7f9318145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 -- 172.21.15.83:0/3718114934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310009ae0 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931d067700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f93100072f0 tx=0x7f9310018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310008b00 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310008c60 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931816d700 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310026460 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.937+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931816dcc0 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.938+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9310003040 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.938+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9310026d60 con 0x7f931815dc00 2023-10-06T04:16:31.944 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.938+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931815a480 con 0x7f931815dc00 2023-10-06T04:16:31.945 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:31.942+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9310021070 con 0x7f931815dc00 2023-10-06T04:16:31.985 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:31.984+0000 7f2215240180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:16:32.021 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:32.018+0000 7f12c98fa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:16:32.028 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.026+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "efc6b257-4e05-4b54-81d7-10aec757d2d3", "id": 4} v 0) v1 -- 0x7f931804c3c0 con 0x7f931815dc00 2023-10-06T04:16:32.035 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.033+0000 7f9314ff9700 1 -- 172.21.15.83:0/3718114934 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efc6b257-4e05-4b54-81d7-10aec757d2d3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9310026810 con 0x7f931815dc00 2023-10-06T04:16:32.035 INFO:teuthology.orchestra.run.smithi083.stdout:4 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 msgr2=0x7f93180b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f93100072f0 tx=0x7f9310018000 comp rx=0 tx=0).stop 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 shutdown_connections 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f931815dc00 0x7f93180b2910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93180cc6e0 0x7f9318145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 --2- 172.21.15.83:0/3718114934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93180ccab0 0x7f931816cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.036 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 >> 172.21.15.83:0/3718114934 conn(0x7f9318068770 msgr2=0x7f93180cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 shutdown_connections 2023-10-06T04:16:32.037 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.034+0000 7f931eaca700 1 -- 172.21.15.83:0/3718114934 wait complete. 2023-10-06T04:16:32.047 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 52fe37c0-1d51-42f3-bb5d-3b98238dec7a 5 2023-10-06T04:16:32.085 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:32.084+0000 7f2215240180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:16:32.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.161+0000 7f82ddaba700 1 Processor -- start 2023-10-06T04:16:32.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.161+0000 7f82ddaba700 1 -- start start 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 0x7f82d8159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 0x7f82d80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d815d680 con 0x7f82d80cc860 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d815a530 con 0x7f82d80ca500 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82ddaba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815a810 con 0x7f82d80ca970 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d6ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 0x7f82d80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.166 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d6ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 0x7f82d80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35634/0 (socket says 172.21.15.83:35634) 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46550/0 (socket says 172.21.15.83:46550) 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d6ffd700 1 -- 172.21.15.83:0/3926102574 learned_addr learned my addr 172.21.15.83:0/3926102574 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d77fe700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 0x7f82d8159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 -- 172.21.15.83:0/3926102574 >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 msgr2=0x7f82d80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 0x7f82d80c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 -- 172.21.15.83:0/3926102574 >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 msgr2=0x7f82d8159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 0x7f82d8159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 -- 172.21.15.83:0/3926102574 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d815aaf0 con 0x7f82d80ca970 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d77fe700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 0x7f82d8159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d7fff700 1 --2- 172.21.15.83:0/3926102574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82d80c8a40 tx=0x7f82d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a054d1b7c0507d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.167 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d67fc700 1 -- 172.21.15.83:0/3926102574 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000e070 con 0x7f82d80ca970 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d67fc700 1 -- 172.21.15.83:0/3926102574 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000bb60 con 0x7f82d80ca970 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.162+0000 7f82d67fc700 1 -- 172.21.15.83:0/3926102574 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0012430 con 0x7f82d80ca970 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 -- 172.21.15.83:0/3926102574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 msgr2=0x7f82d815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 --2- 172.21.15.83:0/3926102574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82d80c8a40 tx=0x7f82d0009780 comp rx=0 tx=0).stop 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 -- 172.21.15.83:0/3926102574 shutdown_connections 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 --2- 172.21.15.83:0/3926102574 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80ca970 0x7f82d815db10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.37:3300/0 conn(0x7f82d80cc860 0x7f82d8159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 --2- 172.21.15.83:0/3926102574 >> v2:172.21.15.83:3300/0 conn(0x7f82d80ca500 0x7f82d80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 -- 172.21.15.83:0/3926102574 >> 172.21.15.83:0/3926102574 conn(0x7f82d80ce470 msgr2=0x7f82d80ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 -- 172.21.15.83:0/3926102574 shutdown_connections 2023-10-06T04:16:32.168 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.163+0000 7f82ddaba700 1 -- 172.21.15.83:0/3926102574 wait complete. 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.164+0000 7f82ddaba700 1 Processor -- start 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.164+0000 7f82ddaba700 1 -- start start 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d80ca500 0x7f82d8143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 0x7f82d815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d80b1a20 con 0x7f82d80ca500 2023-10-06T04:16:32.171 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815c2e0 con 0x7f82d80ca970 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82ddaba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d815c5c0 con 0x7f82d80cc860 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 0x7f82d815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46560/0 (socket says 172.21.15.83:46560) 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d7fff700 1 -- 172.21.15.83:0/137308937 learned_addr learned my addr 172.21.15.83:0/137308937 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d77fe700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d80ca500 0x7f82d8143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 -- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 msgr2=0x7f82d816cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 -- 172.21.15.83:0/137308937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d80ca500 msgr2=0x7f82d8143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d80ca500 0x7f82d8143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.172 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 -- 172.21.15.83:0/137308937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009a20 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d7fff700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.165+0000 7f82d6ffd700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 0x7f82d815ba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e8d0 tx=0x7f82cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc013680 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0137e0 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d815c8a0 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc013b60 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d815bf80 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f82cc005c80 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f82cc0065c0 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.166+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d804c3c0 con 0x7f82d80ca970 2023-10-06T04:16:32.173 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.168+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f82cc021060 con 0x7f82d80ca970 2023-10-06T04:16:32.253 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.251+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52fe37c0-1d51-42f3-bb5d-3b98238dec7a", "id": 5} v 0) v1 -- 0x7f82d806c800 con 0x7f82d80ca970 2023-10-06T04:16:32.261 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.259+0000 7f82bf7fe700 1 -- 172.21.15.83:0/137308937 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52fe37c0-1d51-42f3-bb5d-3b98238dec7a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82cc017070 con 0x7f82d80ca970 2023-10-06T04:16:32.261 INFO:teuthology.orchestra.run.smithi083.stdout:5 2023-10-06T04:16:32.262 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 msgr2=0x7f82d815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 0x7f82d815ba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e8d0 tx=0x7f82cc009250 comp rx=0 tx=0).stop 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 shutdown_connections 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f82d80cc860 0x7f82d816cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d80ca500 0x7f82d8143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 --2- 172.21.15.83:0/137308937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82d80ca970 0x7f82d815ba40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.263 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 >> 172.21.15.83:0/137308937 conn(0x7f82d80ce470 msgr2=0x7f82d806b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 shutdown_connections 2023-10-06T04:16:32.264 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.260+0000 7f82ddaba700 1 -- 172.21.15.83:0/137308937 wait complete. 2023-10-06T04:16:32.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new edfe94f1-d8a1-48ab-844b-e4dce68f140f 6 2023-10-06T04:16:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.390+0000 7f22a3d8f700 1 Processor -- start 2023-10-06T04:16:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.390+0000 7f22a3d8f700 1 -- start start 2023-10-06T04:16:32.394 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a3d8f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 0x7f229c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a3d8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a3d8f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c15e070 con 0x7f229c150890 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a3d8f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229c0ce170 con 0x7f229c150c60 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a3d8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0cb890 con 0x7f229c15dc10 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a1b2b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f229c150890 0x7f229c0cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:54434/0 (socket says 172.21.15.83:54434) 2023-10-06T04:16:32.395 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a1b2b700 1 -- 172.21.15.83:0/1699993639 learned_addr learned my addr 172.21.15.83:0/1699993639 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a132a700 1 --2- 172.21.15.83:0/1699993639 >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 0x7f229c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a0b29700 1 -- 172.21.15.83:0/1699993639 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937644294 0 0) 0x7f2298001290 con 0x7f229c150890 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 -- 172.21.15.83:0/1699993639 >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 msgr2=0x7f229c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 --2- 172.21.15.83:0/1699993639 >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 0x7f229c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 -- 172.21.15.83:0/1699993639 >> v1:172.21.15.83:6789/0 conn(0x7f229c150890 legacy=0x7f229c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 -- 172.21.15.83:0/1699993639 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0cbb70 con 0x7f229c15dc10 2023-10-06T04:16:32.396 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a132a700 1 --2- 172.21.15.83:0/1699993639 >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 0x7f229c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a232c700 1 --2- 172.21.15.83:0/1699993639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c0ccd40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2294009e60 tx=0x7f2294009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66d99a0714ee5ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a0b29700 1 -- 172.21.15.83:0/1699993639 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400e070 con 0x7f229c15dc10 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a0b29700 1 -- 172.21.15.83:0/1699993639 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400bc30 con 0x7f229c15dc10 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.391+0000 7f22a0b29700 1 -- 172.21.15.83:0/1699993639 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294012430 con 0x7f229c15dc10 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 -- 172.21.15.83:0/1699993639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 msgr2=0x7f229c0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.397 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/1699993639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c0ccd40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2294009e60 tx=0x7f2294009780 comp rx=0 tx=0).stop 2023-10-06T04:16:32.398 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 -- 172.21.15.83:0/1699993639 shutdown_connections 2023-10-06T04:16:32.398 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/1699993639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c0ccd40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.398 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/1699993639 >> v2:172.21.15.37:3300/0 conn(0x7f229c150c60 0x7f229c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.398 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 -- 172.21.15.83:0/1699993639 >> 172.21.15.83:0/1699993639 conn(0x7f229c099a30 msgr2=0x7f229c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.398 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 -- 172.21.15.83:0/1699993639 shutdown_connections 2023-10-06T04:16:32.399 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.392+0000 7f22a3d8f700 1 -- 172.21.15.83:0/1699993639 wait complete. 2023-10-06T04:16:32.403 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.393+0000 7f22a3d8f700 1 Processor -- start 2023-10-06T04:16:32.403 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.393+0000 7f22a3d8f700 1 -- start start 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f229c150890 0x7f229c16b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c14fed0 con 0x7f229c150890 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0b4bb0 con 0x7f229c150c60 2023-10-06T04:16:32.404 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a3d8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1568c0 con 0x7f229c15dc10 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35646/0 (socket says 172.21.15.83:35646) 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 -- 172.21.15.83:0/3897449530 learned_addr learned my addr 172.21.15.83:0/3897449530 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a232c700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a1b2b700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f229c150890 0x7f229c16b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 -- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 msgr2=0x7f229c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 -- 172.21.15.83:0/3897449530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f229c150890 msgr2=0x7f229c16b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f229c150890 0x7f229c16b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a132a700 1 -- 172.21.15.83:0/3897449530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009a20 con 0x7f229c150c60 2023-10-06T04:16:32.405 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.394+0000 7f22a232c700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f22a132a700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e8d0 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c013410 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c013570 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c0b4560 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c013910 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f228c013d40 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c156500 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.395+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f228c01b440 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.396+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c04c3c0 con 0x7f229c150c60 2023-10-06T04:16:32.406 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.398+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f228c020060 con 0x7f229c150c60 2023-10-06T04:16:32.484 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.481+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edfe94f1-d8a1-48ab-844b-e4dce68f140f", "id": 6} v 0) v1 -- 0x7f229c0b4cf0 con 0x7f229c150c60 2023-10-06T04:16:32.491 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.489+0000 7f2291ffb700 1 -- 172.21.15.83:0/3897449530 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edfe94f1-d8a1-48ab-844b-e4dce68f140f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f228c00f040 con 0x7f229c150c60 2023-10-06T04:16:32.491 INFO:teuthology.orchestra.run.smithi083.stdout:6 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 msgr2=0x7f229c14f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e8d0 tx=0x7f228c008040 comp rx=0 tx=0).stop 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 shutdown_connections 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f229c15dc10 0x7f229c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f229c150890 0x7f229c16b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 --2- 172.21.15.83:0/3897449530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f229c150c60 0x7f229c14f990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 >> 172.21.15.83:0/3897449530 conn(0x7f229c099a30 msgr2=0x7f229c15a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 shutdown_connections 2023-10-06T04:16:32.494 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.490+0000 7f22a3d8f700 1 -- 172.21.15.83:0/3897449530 wait complete. 2023-10-06T04:16:32.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 8e30625c-4ccf-4858-9ac2-e0a13687671f 7 2023-10-06T04:16:32.552 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:32.550+0000 7f12c98fa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:16:32.618 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.616+0000 7faf9bd01700 1 Processor -- start 2023-10-06T04:16:32.619 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.616+0000 7faf9bd01700 1 -- start start 2023-10-06T04:16:32.622 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9bd01700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf94150a10 0x7faf940aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.622 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9bd01700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf94156bb0 con 0x7faf9406f7e0 2023-10-06T04:16:32.622 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9bd01700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf94157a10 con 0x7faf94150de0 2023-10-06T04:16:32.622 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9bd01700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf94156e00 con 0x7faf94150a10 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9929c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7faf94150de0 0x7faf9406f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:54446/0 (socket says 172.21.15.83:54446) 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.617+0000 7faf9929c700 1 -- 172.21.15.83:0/3393063051 learned_addr learned my addr 172.21.15.83:0/3393063051 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf99a9d700 1 --2- 172.21.15.83:0/3393063051 >> v2:172.21.15.37:3300/0 conn(0x7faf94150a10 0x7faf940aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700694914 0 0) 0x7faf94157a10 con 0x7faf94150de0 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf80003570 con 0x7faf94150de0 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590180961 0 0) 0x7faf94156bb0 con 0x7faf9406f7e0 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf94157a10 con 0x7faf9406f7e0 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf99a9d700 1 -- 172.21.15.83:0/3393063051 >> v1:172.21.15.83:6789/0 conn(0x7faf94150de0 legacy=0x7faf9406f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.623 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf99a9d700 1 -- 172.21.15.83:0/3393063051 >> v1:172.21.15.37:6789/0 conn(0x7faf9406f7e0 legacy=0x7faf940b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf99a9d700 1 -- 172.21.15.83:0/3393063051 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf941570e0 con 0x7faf94150a10 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf99a9d700 1 --2- 172.21.15.83:0/3393063051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150a10 0x7faf940aede0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf840098e0 tx=0x7faf840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83097923b9bc80b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84011630 con 0x7faf94150a10 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84011790 con 0x7faf94150a10 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.618+0000 7faf98a9b700 1 -- 172.21.15.83:0/3393063051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84011b10 con 0x7faf94150a10 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 -- 172.21.15.83:0/3393063051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150a10 msgr2=0x7faf940aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 --2- 172.21.15.83:0/3393063051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150a10 0x7faf940aede0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf840098e0 tx=0x7faf840091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 -- 172.21.15.83:0/3393063051 shutdown_connections 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 --2- 172.21.15.83:0/3393063051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150a10 0x7faf940aede0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 -- 172.21.15.83:0/3393063051 >> 172.21.15.83:0/3393063051 conn(0x7faf94068770 msgr2=0x7faf94068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.624 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 -- 172.21.15.83:0/3393063051 shutdown_connections 2023-10-06T04:16:32.625 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.619+0000 7faf9bd01700 1 -- 172.21.15.83:0/3393063051 wait complete. 2023-10-06T04:16:32.625 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.620+0000 7faf9bd01700 1 Processor -- start 2023-10-06T04:16:32.625 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.620+0000 7faf9bd01700 1 -- start start 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 0x7faf94137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 0x7faf940cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150de0 0x7faf9414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940cdab0 con 0x7faf94150de0 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940cd180 con 0x7faf9406f7e0 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940cd460 con 0x7faf94150a10 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9929c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 0x7faf940cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.629 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9929c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 0x7faf940cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:46576/0 (socket says 172.21.15.83:46576) 2023-10-06T04:16:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9929c700 1 -- 172.21.15.83:0/1791162182 learned_addr learned my addr 172.21.15.83:0/1791162182 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-10-06T04:16:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 0x7faf94137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9a29e700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150de0 0x7faf9414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 -- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 msgr2=0x7faf940cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.630 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 0x7faf940cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 -- 172.21.15.83:0/1791162182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150de0 msgr2=0x7faf9414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150de0 0x7faf9414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 -- 172.21.15.83:0/1791162182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009420 con 0x7faf9406f7e0 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf99a9d700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 0x7faf94137f10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf84016000 tx=0x7faf84017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84011900 con 0x7faf9406f7e0 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84011a60 con 0x7faf9406f7e0 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf940cd740 con 0x7faf9406f7e0 2023-10-06T04:16:32.631 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.621+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8401a680 con 0x7faf9406f7e0 2023-10-06T04:16:32.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.622+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf940ce480 con 0x7faf9406f7e0 2023-10-06T04:16:32.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.622+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faf8401ac70 con 0x7faf9406f7e0 2023-10-06T04:16:32.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.622+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7faf84026a60 con 0x7faf9406f7e0 2023-10-06T04:16:32.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.623+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf940cd2c0 con 0x7faf9406f7e0 2023-10-06T04:16:32.632 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.625+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faf940cd2c0 con 0x7faf9406f7e0 2023-10-06T04:16:32.634 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:32.632+0000 7f12c98fa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:16:32.638 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:32.637+0000 7f2215240180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:16:32.709 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.707+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e30625c-4ccf-4858-9ac2-e0a13687671f", "id": 7} v 0) v1 -- 0x7faf9404c3c0 con 0x7faf9406f7e0 2023-10-06T04:16:32.714 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:32.712+0000 7f12c98fa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:16:32.715 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.713+0000 7faf89ffb700 1 -- 172.21.15.83:0/1791162182 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e30625c-4ccf-4858-9ac2-e0a13687671f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf84015020 con 0x7faf9406f7e0 2023-10-06T04:16:32.716 INFO:teuthology.orchestra.run.smithi083.stdout:7 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 msgr2=0x7faf94137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 0x7faf94137f10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf84016000 tx=0x7faf84017000 comp rx=0 tx=0).stop 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 shutdown_connections 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94150de0 0x7faf9414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faf9406f7e0 0x7faf94137f10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 --2- 172.21.15.83:0/1791162182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faf94150a10 0x7faf940cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 >> 172.21.15.83:0/1791162182 conn(0x7faf94068770 msgr2=0x7faf94068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 shutdown_connections 2023-10-06T04:16:32.718 INFO:teuthology.orchestra.run.smithi083.stderr:2023-10-06T04:16:32.714+0000 7faf9bd01700 1 -- 172.21.15.83:0/1791162182 wait complete. 2023-10-06T04:16:32.720 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:32.719+0000 7f2215240180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:16:32.728 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:16:32.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:16:32.730 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:16:32.731 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:16:32.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:16:32.732 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:16:32.733 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:16:32.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:16:32.735 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:16:32.735 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:16:32.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:16:32.739 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:16:32.740 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:16:32.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:16:32.742 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:16:32.742 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:16:32.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:16:32.744 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:16:32.744 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:16:32.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:16:32.746 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:16:32.746 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:16:32.746 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:16:32.749 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:16:32.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:32.830 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:32.828+0000 7f2215240180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:16:32.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.891+0000 7ff6e8253700 1 Processor -- start 2023-10-06T04:16:32.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 -- start start 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff6e00cb030 0x7ff6e00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 0x7ff6e00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00cb940 con 0x7ff6e00a98e0 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e00c7d80 con 0x7ff6e00cb030 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.892+0000 7ff6e8253700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00cc6d0 con 0x7ff6e00cbd30 2023-10-06T04:16:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e57ee700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6e00a98e0 0x7ff6e00c7070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33184/0 (socket says 172.21.15.37:33184) 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e57ee700 1 -- 172.21.15.37:0/2461190712 learned_addr learned my addr 172.21.15.37:0/2461190712 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 --2- 172.21.15.37:0/2461190712 >> v2:172.21.15.83:3300/0 conn(0x7ff6e00cb030 0x7ff6e00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e67f0700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 0x7ff6e00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e4fed700 1 -- 172.21.15.37:0/2461190712 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401611789 0 0) 0x7ff6e00cb940 con 0x7ff6e00a98e0 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e4fed700 1 -- 172.21.15.37:0/2461190712 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003570 con 0x7ff6e00a98e0 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 -- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 msgr2=0x7ff6e00cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 0x7ff6e00cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 -- 172.21.15.37:0/2461190712 >> v1:172.21.15.37:6789/0 conn(0x7ff6e00a98e0 legacy=0x7ff6e00c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 -- 172.21.15.37:0/2461190712 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0067660 con 0x7ff6e00cb030 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e67f0700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 0x7ff6e00cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e5fef700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00cb030 0x7ff6e00cb400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40098e0 tx=0x7ff6d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5a77fd73938aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e4fed700 1 -- 172.21.15.37:0/2461190712 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011630 con 0x7ff6e00cb030 2023-10-06T04:16:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.893+0000 7ff6e4fed700 1 -- 172.21.15.37:0/2461190712 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d4011790 con 0x7ff6e00cb030 2023-10-06T04:16:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e4fed700 1 -- 172.21.15.37:0/2461190712 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011b30 con 0x7ff6e00cb030 2023-10-06T04:16:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 -- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00cb030 msgr2=0x7ff6e00cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00cb030 0x7ff6e00cb400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40098e0 tx=0x7ff6d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 -- 172.21.15.37:0/2461190712 shutdown_connections 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cbd30 0x7ff6e00cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 --2- 172.21.15.37:0/2461190712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00cb030 0x7ff6e00cb400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 -- 172.21.15.37:0/2461190712 >> 172.21.15.37:0/2461190712 conn(0x7ff6e00c9540 msgr2=0x7ff6e00c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 -- 172.21.15.37:0/2461190712 shutdown_connections 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.894+0000 7ff6e8253700 1 -- 172.21.15.37:0/2461190712 wait complete. 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.895+0000 7ff6e8253700 1 Processor -- start 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.895+0000 7ff6e8253700 1 -- start start 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00a98e0 0x7ff6e00aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cb030 0x7ff6e0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00ae360 con 0x7ff6e00cbd30 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00af2e0 con 0x7ff6e00a98e0 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e8253700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00c4bf0 con 0x7ff6e00cb030 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e67f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e67f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57270/0 (socket says 172.21.15.37:57270) 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e5fef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00a98e0 0x7ff6e00aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e67f0700 1 -- 172.21.15.37:0/838702536 learned_addr learned my addr 172.21.15.37:0/838702536 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.896+0000 7ff6e57ee700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cb030 0x7ff6e0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 -- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cb030 msgr2=0x7ff6e0158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cb030 0x7ff6e0158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 -- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00a98e0 msgr2=0x7ff6e00aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00a98e0 0x7ff6e00aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 -- 172.21.15.37:0/838702536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8009a20 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e67f0700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c0f0 tx=0x7ff6d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800cbd0 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800f040 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4009420 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8014480 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff6d8003020 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e00c42c0 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.897+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ff6d8014d20 con 0x7ff6e00cbd30 2023-10-06T04:16:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.898+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0063410 con 0x7ff6e00cbd30 2023-10-06T04:16:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.901+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff6d8018030 con 0x7ff6e00cbd30 2023-10-06T04:16:32.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.983+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e00c4d30 con 0x7ff6e00cbd30 2023-10-06T04:16:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.984+0000 7ff6d1ffb700 1 -- 172.21.15.37:0/838702536 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff6d8026470 con 0x7ff6e00cbd30 2023-10-06T04:16:32.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:32.987 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:32.710051+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:32.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 msgr2=0x7ff6e00c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:32.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c0f0 tx=0x7ff6d800b040 comp rx=0 tx=0).stop 2023-10-06T04:16:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 shutdown_connections 2023-10-06T04:16:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6e00cbd30 0x7ff6e00c5080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6e00a98e0 0x7ff6e00aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 --2- 172.21.15.37:0/838702536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6e00cb030 0x7ff6e0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 >> 172.21.15.37:0/838702536 conn(0x7ff6e00c9540 msgr2=0x7ff6e0159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 shutdown_connections 2023-10-06T04:16:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:32.985+0000 7ff6e8253700 1 -- 172.21.15.37:0/838702536 wait complete. 2023-10-06T04:16:33.000 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:16:33.000 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:16:33.306 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:33.304+0000 7f12c98fa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:16:33.336 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:16:33.334+0000 7fc390d34540 -1 Falling back to public interface 2023-10-06T04:16:33.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:16:33.336+0000 7ffa82362540 -1 Falling back to public interface 2023-10-06T04:16:33.341 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:16:33.340+0000 7f81cd731540 -1 Falling back to public interface 2023-10-06T04:16:33.342 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:16:33.340+0000 7f1cd8b9a540 -1 Falling back to public interface 2023-10-06T04:16:33.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:16:33.351+0000 7f8288269540 -1 Falling back to public interface 2023-10-06T04:16:33.354 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:16:33.353+0000 7fc466278540 -1 Falling back to public interface 2023-10-06T04:16:33.362 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:16:33.360+0000 7fa642c36540 -1 Falling back to public interface 2023-10-06T04:16:33.363 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:16:33.361+0000 7fd5fd1b4540 -1 Falling back to public interface 2023-10-06T04:16:33.446 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:33.444+0000 7f12c98fa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:16:33.471 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:33.469+0000 7f2215240180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:16:33.536 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:33.534+0000 7f12c98fa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:16:33.614 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:33.612+0000 7f2215240180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:16:33.711 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:33.710+0000 7f2215240180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:16:33.783 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:33.781+0000 7f12c98fa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:16:33.807 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:33.860 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:33.858+0000 7f12c98fa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:16:33.921 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.919+0000 7f406098d700 1 Processor -- start 2023-10-06T04:16:33.921 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.919+0000 7f406098d700 1 -- start start 2023-10-06T04:16:33.927 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f406098d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f405c0cf360 0x7f405c15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.927 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f406098d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0ae470 con 0x7f405c0c6400 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f406098d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0ad860 con 0x7f405c15cb80 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f406098d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0af010 con 0x7f405c0cf360 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f4059d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f405c0c6400 0x7f405c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33194/0 (socket says 172.21.15.37:33194) 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f4059d9b700 1 -- 172.21.15.37:0/3797290992 learned_addr learned my addr 172.21.15.37:0/3797290992 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059406863 0 0) 0x7f405c0ae470 con 0x7f405c0c6400 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.920+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4048003570 con 0x7f405c0c6400 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871331059 0 0) 0x7f405c0ad860 con 0x7f405c15cb80 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c0ae470 con 0x7f405c15cb80 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3797290992 >> v2:172.21.15.83:3300/0 conn(0x7f405c0cf360 0x7f405c15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.928 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3051154183 0 0) 0x7f4048003570 con 0x7f405c0c6400 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 >> v2:172.21.15.83:3300/0 conn(0x7f405c0cf360 msgr2=0x7f405c15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 --2- 172.21.15.37:0/3797290992 >> v2:172.21.15.83:3300/0 conn(0x7f405c0cf360 0x7f405c15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 >> v1:172.21.15.83:6789/0 conn(0x7f405c15cb80 legacy=0x7f405c0ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0adb40 con 0x7f405c0c6400 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f4044001470 con 0x7f405c0c6400 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 >> v1:172.21.15.37:6789/0 conn(0x7f405c0c6400 legacy=0x7f405c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f4048003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4048004810 0x7f4048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.929 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4048005230 0x7f404800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0af010 con 0x7f4048005230 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404800c160 con 0x7f4048003bf0 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404800c320 con 0x7f4048004810 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f4048003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4048005230 0x7f404800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f4059d9b700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4048004810 0x7f4048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 -- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4048004810 msgr2=0x7f4048004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4048004810 0x7f4048004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 -- 172.21.15.37:0/3797290992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4048005230 msgr2=0x7f404800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4048005230 0x7f404800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.930 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405ad9d700 1 -- 172.21.15.37:0/3797290992 reap_dead start 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 -- 172.21.15.37:0/3797290992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048003570 con 0x7f4048003bf0 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.921+0000 7f405a59c700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f4048003fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c3c0 tx=0x7f404c001bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bf700e27ae8e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c001ee0 con 0x7f4048003bf0 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00cc70 con 0x7f4048003bf0 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f405959a700 1 -- 172.21.15.37:0/3797290992 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c012420 con 0x7f4048003bf0 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 -- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 msgr2=0x7f4048003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f4048003fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c3c0 tx=0x7f404c001bd0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 -- 172.21.15.37:0/3797290992 shutdown_connections 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 --2- 172.21.15.37:0/3797290992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f4048003fe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 -- 172.21.15.37:0/3797290992 >> 172.21.15.37:0/3797290992 conn(0x7f405c099960 msgr2=0x7f405c06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 -- 172.21.15.37:0/3797290992 shutdown_connections 2023-10-06T04:16:33.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.922+0000 7f406098d700 1 -- 172.21.15.37:0/3797290992 wait complete. 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.923+0000 7f406098d700 1 Processor -- start 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.923+0000 7f406098d700 1 -- start start 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f405c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f405c16b890 0x7f405c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b41a0 con 0x7f405c16b420 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b3590 con 0x7f4048003bf0 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f406098d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b3870 con 0x7f405c16b890 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f405c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57290/0 (socket says 172.21.15.37:57290) 2023-10-06T04:16:33.932 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f4059d9b700 1 -- 172.21.15.37:0/3430639405 learned_addr learned my addr 172.21.15.37:0/3430639405 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f405c16b890 0x7f405c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405a59c700 1 -- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f405c16b890 msgr2=0x7f405c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405a59c700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f405c16b890 0x7f405c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405a59c700 1 -- 172.21.15.37:0/3430639405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 msgr2=0x7f405c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.924+0000 7f405a59c700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f405a59c700 1 -- 172.21.15.37:0/3430639405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0b3b50 con 0x7f4048003bf0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f4059d9b700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f405a59c700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f405c0b1310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f404c015000 tx=0x7f404c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c012420 con 0x7f4048003bf0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c027470 con 0x7f4048003bf0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0b3e30 con 0x7f4048003bf0 2023-10-06T04:16:33.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c027810 con 0x7f4048003bf0 2023-10-06T04:16:33.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c0b1a10 con 0x7f4048003bf0 2023-10-06T04:16:33.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f404c024070 con 0x7f4048003bf0 2023-10-06T04:16:33.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.925+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f404c01dd40 con 0x7f4048003bf0 2023-10-06T04:16:33.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.926+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c0895e0 con 0x7f4048003bf0 2023-10-06T04:16:33.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.928+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f404c02c020 con 0x7f4048003bf0 2023-10-06T04:16:33.973 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:33.972+0000 7f2215240180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:16:34.000 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:33.999+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405c15d270 con 0x7f4048003bf0 2023-10-06T04:16:34.001 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.000+0000 7f40527fc700 1 -- 172.21.15.37:0/3430639405 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f404c01d660 con 0x7f4048003bf0 2023-10-06T04:16:34.001 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:16:34.001 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:32.710051+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:34.002 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 msgr2=0x7f405c0b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:34.002 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f405c0b1310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f404c015000 tx=0x7f404c016000 comp rx=0 tx=0).stop 2023-10-06T04:16:34.003 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 shutdown_connections 2023-10-06T04:16:34.003 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f405c16b890 0x7f405c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:34.003 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4048003bf0 0x7f405c0b1310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:34.003 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 --2- 172.21.15.37:0/3430639405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c16b420 0x7f405c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:34.004 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 >> 172.21.15.37:0/3430639405 conn(0x7f405c099960 msgr2=0x7f405c06db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:34.004 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 shutdown_connections 2023-10-06T04:16:34.004 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:34.001+0000 7f406098d700 1 -- 172.21.15.37:0/3430639405 wait complete. 2023-10-06T04:16:34.013 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:16:34.054 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:34.053+0000 7f2215240180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:16:34.714 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:34.712+0000 7f12c98fa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:16:34.790 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:34.787+0000 7f12c98fa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:16:34.863 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:34.861+0000 7f12c98fa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:16:34.915 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:34.913+0000 7f2215240180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:16:34.994 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:34.990+0000 7f2215240180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:16:34.999 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:34.997+0000 7f12c98fa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:16:35.068 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.067+0000 7f2215240180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:16:35.085 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:35.083+0000 7f12c98fa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:16:35.206 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.205+0000 7f2215240180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:16:35.235 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:35.233+0000 7f12c98fa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:16:35.294 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.293+0000 7f2215240180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:16:35.312 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:35.310+0000 7f12c98fa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:16:35.387 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:35.385+0000 7f12c98fa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:16:35.451 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.449+0000 7f2215240180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:16:35.461 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:35.459+0000 7f12c98fa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:16:35.533 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.532+0000 7f2215240180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:16:35.612 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.610+0000 7f2215240180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:16:35.691 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T04:16:35.689+0000 7f2215240180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:16:36.484 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:36.482+0000 7f1282cfb700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:16:36.486 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-10-06T04:16:36.484+0000 7f1282cfb700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:16:36.617 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:16:36.616+0000 7f81cd731540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:16:36.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:16:36.817+0000 7ffa82362540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:16:36.825 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:16:36.824+0000 7f1cd8b9a540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:16:36.844 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:16:36.842+0000 7fc466278540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:16:36.866 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:16:36.864+0000 7fc390d34540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:16:36.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:16:36.881+0000 7f8288269540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:16:36.896 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:16:36.894+0000 7fa642c36540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:16:36.898 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:16:36.897+0000 7fd5fd1b4540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:16:40.479 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:16:40.477+0000 7fc387956700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:16:40.486 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-10-06T04:16:40.482+0000 7fc38074d700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.517 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:16:40.515+0000 7fa639858700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:16:40.521 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-10-06T04:16:40.519+0000 7fa63264f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.547 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:16:40.545+0000 7fd5f3dd6700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:16:40.550 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-10-06T04:16:40.548+0000 7fd5ecbcd700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:16:40.558+0000 7f827ee8b700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:16:40.564 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:16:40.562+0000 7f1ccf7bc700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:16:40.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T04:16:40.566+0000 7f8277c82700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.568 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-10-06T04:16:40.566+0000 7f1cc85b3700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.569 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:16:40.568+0000 7f81c4353700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:16:40.574 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T04:16:40.573+0000 7f81bd14a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:16:40.582+0000 7ffa78f84700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:16:40.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T04:16:40.586+0000 7ffa71d7b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.595 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:16:40.594+0000 7fc45ce9a700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:16:40.599 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T04:16:40.598+0000 7fc455c91700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:16:40.819 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:40.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.929+0000 7ff265ec7700 1 Processor -- start 2023-10-06T04:16:40.931 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.929+0000 7ff265ec7700 1 -- start start 2023-10-06T04:16:40.933 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600cab10 0x7ff260159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 0x7ff260159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26006c4f0 0x7ff26006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff260159dd0 con 0x7ff26006c4f0 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2600a9a70 con 0x7ff2600caee0 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff265ec7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26006db00 con 0x7ff2600cab10 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff25ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26006c4f0 0x7ff26006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff25ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26006c4f0 0x7ff26006c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36848/0 (socket says 172.21.15.37:36848) 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.930+0000 7ff25ffff700 1 -- 172.21.15.37:0/2344805415 learned_addr learned my addr 172.21.15.37:0/2344805415 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25effd700 1 --2- 172.21.15.37:0/2344805415 >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 0x7ff260159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25f7fe700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600cab10 0x7ff260159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.934 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 -- 172.21.15.37:0/2344805415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600cab10 msgr2=0x7ff260159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600cab10 0x7ff260159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 -- 172.21.15.37:0/2344805415 >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 msgr2=0x7ff260159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 --2- 172.21.15.37:0/2344805415 >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 0x7ff260159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 -- 172.21.15.37:0/2344805415 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26006d260 con 0x7ff26006c4f0 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25effd700 1 --2- 172.21.15.37:0/2344805415 >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 0x7ff260159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25ffff700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff26006c950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2600ca660 tx=0x7ff258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09ee4a1dcf0c5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25e7fc700 1 -- 172.21.15.37:0/2344805415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25800e070 con 0x7ff26006c4f0 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25e7fc700 1 -- 172.21.15.37:0/2344805415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25800ba50 con 0x7ff26006c4f0 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.931+0000 7ff25e7fc700 1 -- 172.21.15.37:0/2344805415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2580092e0 con 0x7ff26006c4f0 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 -- 172.21.15.37:0/2344805415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 msgr2=0x7ff26006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff26006c950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2600ca660 tx=0x7ff258009840 comp rx=0 tx=0).stop 2023-10-06T04:16:40.935 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 -- 172.21.15.37:0/2344805415 shutdown_connections 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600cab10 0x7ff260159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 --2- 172.21.15.37:0/2344805415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff26006c950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 --2- 172.21.15.37:0/2344805415 >> v2:172.21.15.83:3300/0 conn(0x7ff2600caee0 0x7ff260159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 -- 172.21.15.37:0/2344805415 >> 172.21.15.37:0/2344805415 conn(0x7ff2600c9550 msgr2=0x7ff2600c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 -- 172.21.15.37:0/2344805415 shutdown_connections 2023-10-06T04:16:40.936 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.932+0000 7ff265ec7700 1 -- 172.21.15.37:0/2344805415 wait complete. 2023-10-06T04:16:40.939 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.933+0000 7ff265ec7700 1 Processor -- start 2023-10-06T04:16:40.939 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.933+0000 7ff265ec7700 1 -- start start 2023-10-06T04:16:40.939 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.939 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 0x7ff26015c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.939 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600caee0 0x7ff26015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2601560f0 con 0x7ff26006c4f0 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26015b330 con 0x7ff2600cab10 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26015b610 con 0x7ff2600caee0 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36850/0 (socket says 172.21.15.37:36850) 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 -- 172.21.15.37:0/1137479947 learned_addr learned my addr 172.21.15.37:0/1137479947 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25effd700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 0x7ff26015c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25ffff700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600caee0 0x7ff26015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 -- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600caee0 msgr2=0x7ff26015cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:40.940 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600caee0 0x7ff26015cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 -- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 msgr2=0x7ff26015c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 0x7ff26015c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 -- 172.21.15.37:0/1137479947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258009ae0 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25effd700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 0x7ff26015c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff25f7fe700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d890 tx=0x7ff250008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000b600 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25000b760 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26015b8f0 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25000bae0 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.934+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26015af50 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.935+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26015bd90 con 0x7ff26006c4f0 2023-10-06T04:16:40.941 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.936+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff25001e460 con 0x7ff26006c4f0 2023-10-06T04:16:40.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.936+0000 7ff2477fe700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 0x7ff24c0693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:40.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.936+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7ff250083dd0 con 0x7ff26006c4f0 2023-10-06T04:16:40.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.936+0000 7ff25effd700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 0x7ff24c0693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:40.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.937+0000 7ff25effd700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 0x7ff24c0693d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff254006f00 tx=0x7ff254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:40.942 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:40.941+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff250051e10 con 0x7ff26006c4f0 2023-10-06T04:16:41.135 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.134+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff26004bb80 con 0x7ff26006c4f0 2023-10-06T04:16:41.136 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.135+0000 7ff2477fe700 1 -- 172.21.15.37:0/1137479947 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff250055430 con 0x7ff26006c4f0 2023-10-06T04:16:41.136 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:16:41.136 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:38.480705+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:41.138 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 msgr2=0x7ff24c0693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 0x7ff24c0693d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff254006f00 tx=0x7ff254008040 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 msgr2=0x7ff2601538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff25000d890 tx=0x7ff250008040 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 shutdown_connections 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff2600caee0 0x7ff26015cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26006c4f0 0x7ff2601538a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff24c066f20 0x7ff24c0693d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 --2- 172.21.15.37:0/1137479947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff2600cab10 0x7ff26015c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 >> 172.21.15.37:0/1137479947 conn(0x7ff2600c9550 msgr2=0x7ff260159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:41.139 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 shutdown_connections 2023-10-06T04:16:41.140 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:41.137+0000 7ff265ec7700 1 -- 172.21.15.37:0/1137479947 wait complete. 2023-10-06T04:16:41.150 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:16:47.956 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:48.079 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.077+0000 7f10f5742700 1 Processor -- start 2023-10-06T04:16:48.079 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.077+0000 7f10f5742700 1 -- start start 2023-10-06T04:16:48.080 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10f5742700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f10f00cf5d0 0x7f10f00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.080 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10f5742700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f0157850 con 0x7f10f015aa90 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10f5742700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f00ce130 con 0x7f10f0157480 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10f5742700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f00cb4c0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10ef7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10f015aa90 0x7f10f01633f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35364/0 (socket says 172.21.15.37:35364) 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10ef7fe700 1 -- 172.21.15.37:0/1292890260 learned_addr learned my addr 172.21.15.37:0/1292890260 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10ee7fc700 1 --2- 172.21.15.37:0/1292890260 >> v2:172.21.15.83:3300/0 conn(0x7f10f00cf5d0 0x7f10f00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10edffb700 1 -- 172.21.15.37:0/1292890260 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132365702 0 0) 0x7f10f0157850 con 0x7f10f015aa90 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.078+0000 7f10edffb700 1 -- 172.21.15.37:0/1292890260 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d8003570 con 0x7f10f015aa90 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10ee7fc700 1 -- 172.21.15.37:0/1292890260 >> v1:172.21.15.83:6789/0 conn(0x7f10f0157480 legacy=0x7f10f00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10ee7fc700 1 -- 172.21.15.37:0/1292890260 >> v1:172.21.15.37:6789/0 conn(0x7f10f015aa90 legacy=0x7f10f01633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10ee7fc700 1 -- 172.21.15.37:0/1292890260 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f00cb6b0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.081 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10ee7fc700 1 --2- 172.21.15.37:0/1292890260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f00cf5d0 0x7f10f00cce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10e40098e0 tx=0x7f10e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb7813f002ed570b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.082 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10edffb700 1 -- 172.21.15.37:0/1292890260 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400b640 con 0x7f10f00cf5d0 2023-10-06T04:16:48.082 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10edffb700 1 -- 172.21.15.37:0/1292890260 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e400b7a0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.082 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10edffb700 1 -- 172.21.15.37:0/1292890260 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400bb20 con 0x7f10f00cf5d0 2023-10-06T04:16:48.084 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10f5742700 1 -- 172.21.15.37:0/1292890260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f00cf5d0 msgr2=0x7f10f00cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.084 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.079+0000 7f10f5742700 1 --2- 172.21.15.37:0/1292890260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f00cf5d0 0x7f10f00cce20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10e40098e0 tx=0x7f10e40091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.084 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.080+0000 7f10f5742700 1 -- 172.21.15.37:0/1292890260 shutdown_connections 2023-10-06T04:16:48.084 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.080+0000 7f10f5742700 1 --2- 172.21.15.37:0/1292890260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f00cf5d0 0x7f10f00cce20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.080+0000 7f10f5742700 1 -- 172.21.15.37:0/1292890260 >> 172.21.15.37:0/1292890260 conn(0x7f10f00999a0 msgr2=0x7f10f006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.080+0000 7f10f5742700 1 -- 172.21.15.37:0/1292890260 shutdown_connections 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.080+0000 7f10f5742700 1 -- 172.21.15.37:0/1292890260 wait complete. 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.081+0000 7f10f5742700 1 Processor -- start 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.081+0000 7f10f5742700 1 -- start start 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f0157480 0x7f10f00c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10f015aa90 0x7f10f006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00b0540 con 0x7f10f00cf5d0 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00c68e0 con 0x7f10f0157480 2023-10-06T04:16:48.085 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00afc10 con 0x7f10f015aa90 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51764/0 (socket says 172.21.15.37:51764) 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 -- 172.21.15.37:0/1914794718 learned_addr learned my addr 172.21.15.37:0/1914794718 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10ef7fe700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10f015aa90 0x7f10f006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 -- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10f015aa90 msgr2=0x7f10f006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10f015aa90 0x7f10f006daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 -- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f0157480 msgr2=0x7f10f00c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f0157480 0x7f10f00c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 -- 172.21.15.37:0/1914794718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009420 con 0x7f10f00cf5d0 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10eeffd700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c5b0 tx=0x7f10e0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.086 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011590 con 0x7f10f00cf5d0 2023-10-06T04:16:48.087 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00116f0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.087 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011af0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.087 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f00afef0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.087 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.082+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f00c65f0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.083+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f006d880 con 0x7f10f00cf5d0 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.084+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e001b3b0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.084+0000 7f10d6ffd700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 0x7f10dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.084+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f10e00835e0 con 0x7f10f00cf5d0 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.084+0000 7f10ee7fc700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 0x7f10dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.088 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.085+0000 7f10ee7fc700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 0x7f10dc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10f016d200 tx=0x7f10e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.090 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.089+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e0050c50 con 0x7f10f00cf5d0 2023-10-06T04:16:48.286 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.285+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10f004bb80 con 0x7f10f00cf5d0 2023-10-06T04:16:48.287 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.286+0000 7f10d6ffd700 1 -- 172.21.15.37:0/1914794718 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f10e0017020 con 0x7f10f00cf5d0 2023-10-06T04:16:48.287 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T04:16:48.287 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:44.515552+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:48.289 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 msgr2=0x7f10dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.289 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 0x7f10dc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10f016d200 tx=0x7f10e4017000 comp rx=0 tx=0).stop 2023-10-06T04:16:48.289 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 msgr2=0x7f10f00b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c5b0 tx=0x7f10e0007f30 comp rx=0 tx=0).stop 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 shutdown_connections 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10f015aa90 0x7f10f006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10f00cf5d0 0x7f10f00b26f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f10dc066f30 0x7f10dc0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 --2- 172.21.15.37:0/1914794718 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10f0157480 0x7f10f00c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 >> 172.21.15.37:0/1914794718 conn(0x7f10f00999a0 msgr2=0x7f10f0156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 shutdown_connections 2023-10-06T04:16:48.290 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T04:16:48.288+0000 7f10f5742700 1 -- 172.21.15.37:0/1914794718 wait complete. 2023-10-06T04:16:48.300 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:16:48.300 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:16:48.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:16:48.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.418+0000 7fa4b0dc5700 1 Processor -- start 2023-10-06T04:16:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.418+0000 7fa4b0dc5700 1 -- start start 2023-10-06T04:16:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4b0dc5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4b0dc5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 0x7fa4ac0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4b0dc5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0b5ff0 con 0x7fa4ac0d02e0 2023-10-06T04:16:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4b0dc5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac0b53e0 con 0x7fa4ac153d90 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4b0dc5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0b56c0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4aaffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 0x7fa4ac0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:47582/0 (socket says 172.21.15.37:47582) 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 -- 172.21.15.37:0/2376870727 learned_addr learned my addr 172.21.15.37:0/2376870727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 -- 172.21.15.37:0/2376870727 >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 msgr2=0x7fa4ac0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2376870727 >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 0x7fa4ac0b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 -- 172.21.15.37:0/2376870727 >> v1:172.21.15.83:6789/0 conn(0x7fa4ac0d02e0 legacy=0x7fa4ac15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4ab7fe700 1 -- 172.21.15.37:0/2376870727 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0b59a0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.419+0000 7fa4aaffd700 1 --2- 172.21.15.37:0/2376870727 >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 0x7fa4ac0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2376870727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0099b0 tx=0x7fa49c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aaa566edf7a3347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4aa7fc700 1 -- 172.21.15.37:0/2376870727 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c009ea0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4aa7fc700 1 -- 172.21.15.37:0/2376870727 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00b860 con 0x7fa4ac1539c0 2023-10-06T04:16:48.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4aa7fc700 1 -- 172.21.15.37:0/2376870727 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00bc00 con 0x7fa4ac1539c0 2023-10-06T04:16:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2376870727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 msgr2=0x7fa4ac159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2376870727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0099b0 tx=0x7fa49c009250 comp rx=0 tx=0).stop 2023-10-06T04:16:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2376870727 shutdown_connections 2023-10-06T04:16:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2376870727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac1539c0 0x7fa4ac159b00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2376870727 >> v2:172.21.15.83:3300/0 conn(0x7fa4ac153d90 0x7fa4ac0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2376870727 >> 172.21.15.37:0/2376870727 conn(0x7fa4ac06ed90 msgr2=0x7fa4ac06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2376870727 shutdown_connections 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.420+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2376870727 wait complete. 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.422+0000 7fa4b0dc5700 1 Processor -- start 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.422+0000 7fa4b0dc5700 1 -- start start 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.422+0000 7fa4b0dc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 0x7fa4ac151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.422+0000 7fa4b0dc5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51770/0 (socket says 172.21.15.37:51770) 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac153d90 0x7fa4ac15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 -- 172.21.15.37:0/2580288815 learned_addr learned my addr 172.21.15.37:0/2580288815 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:48.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac16a700 con 0x7fa4ac1539c0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac1561d0 con 0x7fa4ac0d02e0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac152680 con 0x7fa4ac153d90 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 0x7fa4ac151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4abfff700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac153d90 0x7fa4ac15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 -- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac153d90 msgr2=0x7fa4ac15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac153d90 0x7fa4ac15f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 -- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 msgr2=0x7fa4ac151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 0x7fa4ac151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009420 con 0x7fa4ac1539c0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 0x7fa4ac151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4aaffd700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000ecb0 tx=0x7fa4a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000c9d0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000cb30 con 0x7fa4ac1539c0 2023-10-06T04:16:48.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000ced0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c0094f0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.423+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac16a1a0 con 0x7fa4ac1539c0 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.424+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac156380 con 0x7fa4ac1539c0 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.425+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4a0013680 con 0x7fa4ac1539c0 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.425+0000 7fa4937fe700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 0x7fa4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.425+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa4a0084310 con 0x7fa4ac1539c0 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.425+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 0x7fa4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:48.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.426+0000 7fa4ab7fe700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 0x7fa4980693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0099b0 tx=0x7fa49c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.429+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4ac156380 con 0x7fa4ac1539c0 2023-10-06T04:16:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:48.623+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa4ac156380 con 0x7fa4ac1539c0 2023-10-06T04:16:49.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.598+0000 7fa4937fe700 1 -- 172.21.15.37:0/2580288815 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa4ac156380 con 0x7fa4ac1539c0 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.601+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 msgr2=0x7fa4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.601+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 0x7fa4980693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0099b0 tx=0x7fa49c017000 comp rx=0 tx=0).stop 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.601+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 msgr2=0x7fa4ac15f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.601+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000ecb0 tx=0x7fa4a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.601+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 shutdown_connections 2023-10-06T04:16:49.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4ac153d90 0x7fa4ac15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa498066f30 0x7fa4980693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4ac0d02e0 0x7fa4ac151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 --2- 172.21.15.37:0/2580288815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4ac1539c0 0x7fa4ac15f260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 >> 172.21.15.37:0/2580288815 conn(0x7fa4ac06ed90 msgr2=0x7fa4ac0b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:49.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 shutdown_connections 2023-10-06T04:16:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.602+0000 7fa4b0dc5700 1 -- 172.21.15.37:0/2580288815 wait complete. 2023-10-06T04:16:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-10-06T04:16:49.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:16:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.745+0000 7ff1a8a6f700 1 Processor -- start 2023-10-06T04:16:49.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.745+0000 7ff1a8a6f700 1 -- start start 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a8a6f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1a40cf260 0x7ff1a40c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a8a6f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40cbb00 con 0x7ff1a4159da0 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a8a6f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a40cdc50 con 0x7ff1a40cd020 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a8a6f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40cdf30 con 0x7ff1a40cf260 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a1d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1a40cf260 0x7ff1a40c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a1d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1a40cf260 0x7ff1a40c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51776/0 (socket says 172.21.15.37:51776) 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a1d9b700 1 -- 172.21.15.37:0/2747523640 learned_addr learned my addr 172.21.15.37:0/2747523640 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a1d9b700 1 -- 172.21.15.37:0/2747523640 >> v1:172.21.15.83:6789/0 conn(0x7ff1a40cd020 legacy=0x7ff1a40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.746+0000 7ff1a1d9b700 1 -- 172.21.15.37:0/2747523640 >> v1:172.21.15.37:6789/0 conn(0x7ff1a4159da0 legacy=0x7ff1a40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a1d9b700 1 -- 172.21.15.37:0/2747523640 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40cb790 con 0x7ff1a40cf260 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a159a700 1 -- 172.21.15.37:0/2747523640 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781146509 0 0) 0x7ff1a40cbb00 con 0x7ff1a4159da0 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a1d9b700 1 --2- 172.21.15.37:0/2747523640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cf260 0x7ff1a40c5410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099b0 tx=0x7ff18c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d37c10f79e91c9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a159a700 1 -- 172.21.15.37:0/2747523640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00b820 con 0x7ff1a40cf260 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a159a700 1 -- 172.21.15.37:0/2747523640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00b980 con 0x7ff1a40cf260 2023-10-06T04:16:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a159a700 1 -- 172.21.15.37:0/2747523640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00bd20 con 0x7ff1a40cf260 2023-10-06T04:16:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/2747523640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cf260 msgr2=0x7ff1a40c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/2747523640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cf260 0x7ff1a40c5410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099b0 tx=0x7ff18c009250 comp rx=0 tx=0).stop 2023-10-06T04:16:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/2747523640 shutdown_connections 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/2747523640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cf260 0x7ff1a40c5410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.747+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/2747523640 >> 172.21.15.37:0/2747523640 conn(0x7ff1a4099aa0 msgr2=0x7ff1a406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.748+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/2747523640 shutdown_connections 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.748+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/2747523640 wait complete. 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 Processor -- start 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 -- start start 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 0x7ff1a41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 0x7ff1a40b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40b3c00 con 0x7ff1a40cd020 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4151c10 con 0x7ff1a40cf260 2023-10-06T04:16:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a8a6f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40c9bf0 con 0x7ff1a4159da0 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51778/0 (socket says 172.21.15.37:51778) 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.749+0000 7ff1a259c700 1 -- 172.21.15.37:0/324238530 learned_addr learned my addr 172.21.15.37:0/324238530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a2d9d700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 0x7ff1a40b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a1d9b700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 0x7ff1a41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 -- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 msgr2=0x7ff1a40b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 0x7ff1a40b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 -- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 msgr2=0x7ff1a41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 0x7ff1a41516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 -- 172.21.15.37:0/324238530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0094f0 con 0x7ff1a40cd020 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a1d9b700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 0x7ff1a41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a2d9d700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 0x7ff1a40b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a259c700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00c5c0 tx=0x7ff19c001050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00e4a0 con 0x7ff1a40cd020 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00e620 con 0x7ff1a40cd020 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a40b35b0 con 0x7ff1a40cd020 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00e9e0 con 0x7ff1a40cd020 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.750+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a40b5cc0 con 0x7ff1a40cd020 2023-10-06T04:16:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.751+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a40b3410 con 0x7ff1a40cd020 2023-10-06T04:16:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.752+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff19c01b3b0 con 0x7ff1a40cd020 2023-10-06T04:16:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.752+0000 7ff19a7fc700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.752+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7ff19c083930 con 0x7ff1a40cd020 2023-10-06T04:16:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.752+0000 7ff1a1d9b700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.753+0000 7ff1a1d9b700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 0x7ff1840693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099b0 tx=0x7ff18c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.757+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1a40b3410 con 0x7ff1a40cd020 2023-10-06T04:16:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:49.951+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1a40b3410 con 0x7ff1a40cd020 2023-10-06T04:16:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.608+0000 7ff19a7fc700 1 -- 172.21.15.37:0/324238530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff1a40b3410 con 0x7ff1a40cd020 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 msgr2=0x7ff1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 0x7ff1840693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099b0 tx=0x7ff18c016000 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 msgr2=0x7ff1a416b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00c5c0 tx=0x7ff19c001050 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 shutdown_connections 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a4159da0 0x7ff1a40b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a40cd020 0x7ff1a416b3d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff184066f30 0x7ff1840693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 --2- 172.21.15.37:0/324238530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a40cf260 0x7ff1a41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 >> 172.21.15.37:0/324238530 conn(0x7ff1a4099aa0 msgr2=0x7ff1a4151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 shutdown_connections 2023-10-06T04:16:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.611+0000 7ff1a8a6f700 1 -- 172.21.15.37:0/324238530 wait complete. 2023-10-06T04:16:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:16:50.628 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:16:50.629 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:16:50.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:16:50.631 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:16:50.631 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:16:50.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:16:50.633 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:16:50.633 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:16:50.633 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:16:50.636 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:16:50.636 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:16:50.637 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:16:50.638 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:16:50.639 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:16:50.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:50.713 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:16:50.713 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:16:50.715 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:16:50.716 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:16:50.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.768+0000 7f0e4f2b0700 1 Processor -- start 2023-10-06T04:16:50.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.768+0000 7f0e4f2b0700 1 -- start start 2023-10-06T04:16:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4f2b0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e480b4150 0x7f0e48162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4f2b0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480ccf70 con 0x7f0e480ccac0 2023-10-06T04:16:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4f2b0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480cd250 con 0x7f0e480b3d80 2023-10-06T04:16:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4f2b0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480cafe0 con 0x7f0e480b4150 2023-10-06T04:16:50.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4d84d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e480b4150 0x7f0e48162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4c84b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0e480ccac0 0x7f0e4806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35386/0 (socket says 172.21.15.37:35386) 2023-10-06T04:16:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4c84b700 1 -- 172.21.15.37:0/1631659700 learned_addr learned my addr 172.21.15.37:0/1631659700 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803998118 0 0) 0x7f0e480ccf70 con 0x7f0e480ccac0 2023-10-06T04:16:50.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e34003570 con 0x7f0e480ccac0 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4d84d700 1 -- 172.21.15.37:0/1631659700 >> v1:172.21.15.83:6789/0 conn(0x7f0e480b3d80 legacy=0x7f0e480cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042656345 0 0) 0x7f0e480cd250 con 0x7f0e480b3d80 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4d84d700 1 -- 172.21.15.37:0/1631659700 >> v1:172.21.15.37:6789/0 conn(0x7f0e480ccac0 legacy=0x7f0e4806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4d84d700 1 -- 172.21.15.37:0/1631659700 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480cd530 con 0x7f0e480b4150 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e4d84d700 1 --2- 172.21.15.37:0/1631659700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b4150 0x7f0e48162160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009e60 tx=0x7f0e40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f80bae09af180f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000e070 con 0x7f0e480b4150 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000bb60 con 0x7f0e480b4150 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.769+0000 7f0e3ffff700 1 -- 172.21.15.37:0/1631659700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40012430 con 0x7f0e480b4150 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1631659700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b4150 msgr2=0x7f0e48162160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1631659700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b4150 0x7f0e48162160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009e60 tx=0x7f0e40009780 comp rx=0 tx=0).stop 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1631659700 shutdown_connections 2023-10-06T04:16:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1631659700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b4150 0x7f0e48162160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1631659700 >> 172.21.15.37:0/1631659700 conn(0x7f0e480ce470 msgr2=0x7f0e480ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1631659700 shutdown_connections 2023-10-06T04:16:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.770+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1631659700 wait complete. 2023-10-06T04:16:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.771+0000 7f0e4f2b0700 1 Processor -- start 2023-10-06T04:16:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.771+0000 7f0e4f2b0700 1 -- start start 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e480b4150 0x7f0e4806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e480ccac0 0x7f0e4806be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48068d90 con 0x7f0e480b3d80 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48069320 con 0x7f0e480b4150 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4f2b0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e481486a0 con 0x7f0e480ccac0 2023-10-06T04:16:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51818/0 (socket says 172.21.15.37:51818) 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 -- 172.21.15.37:0/1616361006 learned_addr learned my addr 172.21.15.37:0/1616361006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d84d700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e480ccac0 0x7f0e4806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4c84b700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e480b4150 0x7f0e4806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 -- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e480ccac0 msgr2=0x7f0e4806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e480ccac0 0x7f0e4806be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 -- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e480b4150 msgr2=0x7f0e4806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e480b4150 0x7f0e4806b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.772+0000 7f0e4d04c700 1 -- 172.21.15.37:0/1616361006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009a20 con 0x7f0e480b3d80 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e4d04c700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c5b0 tx=0x7f0e44001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011590 con 0x7f0e480b3d80 2023-10-06T04:16:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440116f0 con 0x7f0e480b3d80 2023-10-06T04:16:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e48148940 con 0x7f0e480b3d80 2023-10-06T04:16:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011ab0 con 0x7f0e480b3d80 2023-10-06T04:16:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.773+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e48148f00 con 0x7f0e480b3d80 2023-10-06T04:16:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.774+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e48063410 con 0x7f0e480b3d80 2023-10-06T04:16:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.774+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e4401b3b0 con 0x7f0e480b3d80 2023-10-06T04:16:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.775+0000 7f0e3d7fa700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.775+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0e44083620 con 0x7f0e480b3d80 2023-10-06T04:16:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.775+0000 7f0e4c84b700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.775+0000 7f0e4c84b700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 0x7f0e2c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e48069110 tx=0x7f0e38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.779+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e44050b30 con 0x7f0e480b3d80 2023-10-06T04:16:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.977+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e4806c9a0 con 0x7f0e480b3d80 2023-10-06T04:16:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.978+0000 7f0e3d7fa700 1 -- 172.21.15.37:0/1616361006 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13612 (secure 0 0 0) 0x7f0e44017020 con 0x7f0e480b3d80 2023-10-06T04:16:50.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:50.980 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:50.597347+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 msgr2=0x7f0e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 0x7f0e2c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e48069110 tx=0x7f0e38009040 comp rx=0 tx=0).stop 2023-10-06T04:16:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 msgr2=0x7f0e48147350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:50.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c5b0 tx=0x7f0e44001060 comp rx=0 tx=0).stop 2023-10-06T04:16:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 shutdown_connections 2023-10-06T04:16:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e480ccac0 0x7f0e4806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e480b3d80 0x7f0e48147350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 --2- 172.21.15.37:0/1616361006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e480b4150 0x7f0e4806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 >> 172.21.15.37:0/1616361006 conn(0x7f0e480ce470 msgr2=0x7f0e48150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 shutdown_connections 2023-10-06T04:16:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:50.980+0000 7f0e4f2b0700 1 -- 172.21.15.37:0/1616361006 wait complete. 2023-10-06T04:16:50.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:16:50.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:16:51.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.115+0000 7fb9972e1700 1 Processor -- start 2023-10-06T04:16:51.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.115+0000 7fb9972e1700 1 -- start start 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb9972e1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 0x7fb9900cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb9972e1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900cdb20 con 0x7fb9900ceff0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb9972e1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900c5430 con 0x7fb990159dc0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb9972e1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900b3090 con 0x7fb9900ce260 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99587e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9900ceff0 0x7fb9900c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35392/0 (socket says 172.21.15.37:35392) 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99587e700 1 -- 172.21.15.37:0/232097052 learned_addr learned my addr 172.21.15.37:0/232097052 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99487c700 1 --2- 172.21.15.37:0/232097052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 0x7fb9900cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070704302 0 0) 0x7fb9900cdb20 con 0x7fb9900ceff0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb97c003570 con 0x7fb9900ceff0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262100042 0 0) 0x7fb9900c5430 con 0x7fb990159dc0 2023-10-06T04:16:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9900cdb20 con 0x7fb990159dc0 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99487c700 1 -- 172.21.15.37:0/232097052 >> v1:172.21.15.83:6789/0 conn(0x7fb990159dc0 legacy=0x7fb9900ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99487c700 1 -- 172.21.15.37:0/232097052 >> v1:172.21.15.37:6789/0 conn(0x7fb9900ceff0 legacy=0x7fb9900c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99487c700 1 -- 172.21.15.37:0/232097052 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900c6290 con 0x7fb9900ce260 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.116+0000 7fb99487c700 1 --2- 172.21.15.37:0/232097052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 0x7fb9900cc6a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb980009910 tx=0x7fb9800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5829eb85efa507c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011630 con 0x7fb9900ce260 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980011790 con 0x7fb9900ce260 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb987fff700 1 -- 172.21.15.37:0/232097052 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011b30 con 0x7fb9900ce260 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 -- 172.21.15.37:0/232097052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 msgr2=0x7fb9900cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 --2- 172.21.15.37:0/232097052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 0x7fb9900cc6a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb980009910 tx=0x7fb9800091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 -- 172.21.15.37:0/232097052 shutdown_connections 2023-10-06T04:16:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 --2- 172.21.15.37:0/232097052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9900ce260 0x7fb9900cc6a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 -- 172.21.15.37:0/232097052 >> 172.21.15.37:0/232097052 conn(0x7fb990099a50 msgr2=0x7fb99006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 -- 172.21.15.37:0/232097052 shutdown_connections 2023-10-06T04:16:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.117+0000 7fb9972e1700 1 -- 172.21.15.37:0/232097052 wait complete. 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.118+0000 7fb9972e1700 1 Processor -- start 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.118+0000 7fb9972e1700 1 -- start start 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9900ceff0 0x7fb9901586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb990159dc0 0x7fb990169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99015a660 con 0x7fb9900ce260 2023-10-06T04:16:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99016de10 con 0x7fb9900ceff0 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb9972e1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99009b950 con 0x7fb990159dc0 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99507d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99507d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51824/0 (socket says 172.21.15.37:51824) 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99507d700 1 -- 172.21.15.37:0/2005982070 learned_addr learned my addr 172.21.15.37:0/2005982070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99587e700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb990159dc0 0x7fb990169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99487c700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9900ceff0 0x7fb9901586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.119+0000 7fb99507d700 1 -- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb990159dc0 msgr2=0x7fb990169990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb99507d700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb990159dc0 0x7fb990169990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb99507d700 1 -- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9900ceff0 msgr2=0x7fb9901586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb99507d700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9900ceff0 0x7fb9901586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb99507d700 1 -- 172.21.15.37:0/2005982070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980009420 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb99507d700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c7c0 tx=0x7fb98c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c001530 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0016b0 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c001a70 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99009c1f0 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.120+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99009e1a0 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.121+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99004c3c0 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.121+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb98c01b3b0 con 0x7fb9900ce260 2023-10-06T04:16:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.122+0000 7fb9857fa700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 0x7fb9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.122+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb98c083a90 con 0x7fb9900ce260 2023-10-06T04:16:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.122+0000 7fb99487c700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 0x7fb9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.123+0000 7fb99487c700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 0x7fb9740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9800091e0 tx=0x7fb980017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.126+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb98c050ef0 con 0x7fb9900ce260 2023-10-06T04:16:51.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.319+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb990067fd0 con 0x7fb9900ce260 2023-10-06T04:16:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.319+0000 7fb9857fa700 1 -- 172.21.15.37:0/2005982070 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb98c017070 con 0x7fb9900ce260 2023-10-06T04:16:51.321 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 msgr2=0x7fb9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 0x7fb9740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9800091e0 tx=0x7fb980017000 comp rx=0 tx=0).stop 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 msgr2=0x7fb99016d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00c7c0 tx=0x7fb98c007e00 comp rx=0 tx=0).stop 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 shutdown_connections 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb990159dc0 0x7fb990169990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9900ce260 0x7fb99016d8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb974066f30 0x7fb9740693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 --2- 172.21.15.37:0/2005982070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9900ceff0 0x7fb9901586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 >> 172.21.15.37:0/2005982070 conn(0x7fb990099a50 msgr2=0x7fb9900ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 shutdown_connections 2023-10-06T04:16:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.321+0000 7fb9972e1700 1 -- 172.21.15.37:0/2005982070 wait complete. 2023-10-06T04:16:51.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:16:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.455+0000 7f166636b700 1 Processor -- start 2023-10-06T04:16:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.455+0000 7f166636b700 1 -- start start 2023-10-06T04:16:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f166636b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16600ce260 0x7f16600cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f166636b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f166636b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600cdb20 con 0x7f1660159dc0 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f166636b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600cf9d0 con 0x7f16600ce260 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f166636b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600b3090 con 0x7f16600ceff0 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16600ce260 0x7f16600cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f1664908700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165ffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1660159dc0 0x7f16600ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:40150/0 (socket says 172.21.15.37:40150) 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165ffff700 1 -- 172.21.15.37:0/2704056833 learned_addr learned my addr 172.21.15.37:0/2704056833 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16600ce260 0x7f16600cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:51406/0 (socket says 172.21.15.37:51406) 2023-10-06T04:16:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f1664908700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:47668/0 (socket says 172.21.15.37:47668) 2023-10-06T04:16:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 -- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 msgr2=0x7f16600cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 -- 172.21.15.37:0/2704056833 >> v1:172.21.15.83:6789/0 conn(0x7f1660159dc0 legacy=0x7f16600ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165f7fe700 1 -- 172.21.15.37:0/2704056833 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600c5430 con 0x7f16600ce260 2023-10-06T04:16:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f165effd700 1 -- 172.21.15.37:0/2704056833 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156093272 0 0) 0x7f16600cdb20 con 0x7f1660159dc0 2023-10-06T04:16:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.456+0000 7f1664908700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f165f7fe700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600cc6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16500098e0 tx=0x7f16500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a092a6b9796096 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f165effd700 1 -- 172.21.15.37:0/2704056833 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000b640 con 0x7f16600ce260 2023-10-06T04:16:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f165effd700 1 -- 172.21.15.37:0/2704056833 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000b7a0 con 0x7f16600ce260 2023-10-06T04:16:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f165effd700 1 -- 172.21.15.37:0/2704056833 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000bb40 con 0x7f16600ce260 2023-10-06T04:16:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 -- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 msgr2=0x7f16600cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600cc6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16500098e0 tx=0x7f16500091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 -- 172.21.15.37:0/2704056833 shutdown_connections 2023-10-06T04:16:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16600cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 --2- 172.21.15.37:0/2704056833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600cc6a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 -- 172.21.15.37:0/2704056833 >> 172.21.15.37:0/2704056833 conn(0x7f1660099a50 msgr2=0x7f166006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 -- 172.21.15.37:0/2704056833 shutdown_connections 2023-10-06T04:16:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.457+0000 7f166636b700 1 -- 172.21.15.37:0/2704056833 wait complete. 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 Processor -- start 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 -- start start 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16601514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c7c00 con 0x7f1660159dc0 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600b4240 con 0x7f16600ce260 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.459+0000 7f166636b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c7ec0 con 0x7f16600ceff0 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51832/0 (socket says 172.21.15.37:51832) 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 -- 172.21.15.37:0/426417935 learned_addr learned my addr 172.21.15.37:0/426417935 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f165ffff700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f165f7fe700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16601514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 -- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 msgr2=0x7f16601514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16601514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 -- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 msgr2=0x7f16600b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 -- 172.21.15.37:0/426417935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658009a20 con 0x7f1660159dc0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f165ffff700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f165f7fe700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16601514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1664908700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1658009fc0 tx=0x7f165800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800cd30 con 0x7f1660159dc0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165800f040 con 0x7f1660159dc0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650009420 con 0x7f1660159dc0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16580146d0 con 0x7f1660159dc0 2023-10-06T04:16:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.460+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16600b3a50 con 0x7f1660159dc0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.461+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16600c8030 con 0x7f1660159dc0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.462+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1658003020 con 0x7f1660159dc0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.462+0000 7f1647fff700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 0x7f164c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.462+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1658084db0 con 0x7f1660159dc0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.462+0000 7f165ffff700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 0x7f164c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.463+0000 7f165ffff700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 0x7f164c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1654001230 tx=0x7f1654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.467+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1658052210 con 0x7f1660159dc0 2023-10-06T04:16:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.662+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f166004c3c0 con 0x7f1660159dc0 2023-10-06T04:16:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.662+0000 7f1647fff700 1 -- 172.21.15.37:0/426417935 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1658059e60 con 0x7f1660159dc0 2023-10-06T04:16:51.664 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:16:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 msgr2=0x7f164c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 0x7f164c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1654001230 tx=0x7f1654009040 comp rx=0 tx=0).stop 2023-10-06T04:16:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 msgr2=0x7f1660158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1658009fc0 tx=0x7f165800b040 comp rx=0 tx=0).stop 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 shutdown_connections 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1660159dc0 0x7f1660158da0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f164c066f30 0x7f164c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16600ce260 0x7f16600b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 --2- 172.21.15.37:0/426417935 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16600ceff0 0x7f16601514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.664+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 >> 172.21.15.37:0/426417935 conn(0x7f1660099a50 msgr2=0x7f16600ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.665+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 shutdown_connections 2023-10-06T04:16:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.665+0000 7f166636b700 1 -- 172.21.15.37:0/426417935 wait complete. 2023-10-06T04:16:51.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:16:51.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.797+0000 7f3c3d984700 1 Processor -- start 2023-10-06T04:16:51.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.797+0000 7f3c3d984700 1 -- start start 2023-10-06T04:16:51.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.798+0000 7f3c3d984700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 0x7f3c38067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.798+0000 7f3c3d984700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 0x7f3c380cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.798+0000 7f3c3d984700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3815c010 con 0x7f3c38068320 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.798+0000 7f3c3d984700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3815b400 con 0x7f3c380b26d0 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.798+0000 7f3c3d984700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3815b6e0 con 0x7f3c38157900 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c36ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 0x7f3c38067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 0x7f3c380cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c367fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3c38068320 0x7f3c381571f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:40160/0 (socket says 172.21.15.37:40160) 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c367fc700 1 -- 172.21.15.37:0/1878847025 learned_addr learned my addr 172.21.15.37:0/1878847025 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 -- 172.21.15.37:0/1878847025 >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 msgr2=0x7f3c38067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 --2- 172.21.15.37:0/1878847025 >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 0x7f3c38067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 -- 172.21.15.37:0/1878847025 >> v1:172.21.15.83:6789/0 conn(0x7f3c38068320 legacy=0x7f3c381571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 -- 172.21.15.37:0/1878847025 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3815b9c0 con 0x7f3c38157900 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c36ffd700 1 --2- 172.21.15.37:0/1878847025 >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 0x7f3c38067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c377fe700 1 --2- 172.21.15.37:0/1878847025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 0x7f3c380cb340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e60 tx=0x7f3c28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd66fcebb3453a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c35ffb700 1 -- 172.21.15.37:0/1878847025 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800e070 con 0x7f3c38157900 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c35ffb700 1 -- 172.21.15.37:0/1878847025 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800bb60 con 0x7f3c38157900 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.799+0000 7f3c35ffb700 1 -- 172.21.15.37:0/1878847025 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012430 con 0x7f3c38157900 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 -- 172.21.15.37:0/1878847025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 msgr2=0x7f3c380cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 --2- 172.21.15.37:0/1878847025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 0x7f3c380cb340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e60 tx=0x7f3c28009780 comp rx=0 tx=0).stop 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 -- 172.21.15.37:0/1878847025 shutdown_connections 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 --2- 172.21.15.37:0/1878847025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38157900 0x7f3c380cb340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 --2- 172.21.15.37:0/1878847025 >> v2:172.21.15.83:3300/0 conn(0x7f3c380b26d0 0x7f3c38067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 -- 172.21.15.37:0/1878847025 >> 172.21.15.37:0/1878847025 conn(0x7f3c38068770 msgr2=0x7f3c38068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:51.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 -- 172.21.15.37:0/1878847025 shutdown_connections 2023-10-06T04:16:51.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.800+0000 7f3c3d984700 1 -- 172.21.15.37:0/1878847025 wait complete. 2023-10-06T04:16:51.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.801+0000 7f3c3d984700 1 Processor -- start 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.801+0000 7f3c3d984700 1 -- start start 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38068320 0x7f3c38168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c380b26d0 0x7f3c3816b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380aee40 con 0x7f3c38157900 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3816b420 con 0x7f3c380b26d0 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c3d984700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381688a0 con 0x7f3c38068320 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51840/0 (socket says 172.21.15.37:51840) 2023-10-06T04:16:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 -- 172.21.15.37:0/2228689200 learned_addr learned my addr 172.21.15.37:0/2228689200 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c36ffd700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38068320 0x7f3c38168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c367fc700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c380b26d0 0x7f3c3816b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 -- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38068320 msgr2=0x7f3c38168360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38068320 0x7f3c38168360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 -- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c380b26d0 msgr2=0x7f3c3816b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c380b26d0 0x7f3c3816b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 -- 172.21.15.37:0/2228689200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009420 con 0x7f3c38157900 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.802+0000 7f3c377fe700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c3815b820 tx=0x7f3c28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.803+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012ea0 con 0x7f3c38157900 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.803+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28027470 con 0x7f3c38157900 2023-10-06T04:16:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.803+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c28009a20 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.803+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28027850 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.803+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c380aeb60 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.804+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3816b5d0 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.804+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c28024070 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.804+0000 7f3c2effd700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 0x7f3c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.805+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3c28086df0 con 0x7f3c38157900 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.805+0000 7f3c36ffd700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 0x7f3c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:51.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.805+0000 7f3c36ffd700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 0x7f3c180693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009f40 tx=0x7f3c300091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:51.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:51.809+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c3816b5d0 con 0x7f3c38157900 2023-10-06T04:16:52.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.046+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c3816b590 con 0x7f3c38157900 2023-10-06T04:16:52.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.047+0000 7f3c2effd700 1 -- 172.21.15.37:0/2228689200 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f3c28054250 con 0x7f3c38157900 2023-10-06T04:16:52.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:52.049 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4306,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T04:16:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.048+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 msgr2=0x7f3c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.048+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 0x7f3c180693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009f40 tx=0x7f3c300091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.048+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 msgr2=0x7f3c38147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.048+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c3815b820 tx=0x7f3c28019000 comp rx=0 tx=0).stop 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 shutdown_connections 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c38157900 0x7f3c38147060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c38068320 0x7f3c38168360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c18066f30 0x7f3c180693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 --2- 172.21.15.37:0/2228689200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c380b26d0 0x7f3c3816b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 >> 172.21.15.37:0/2228689200 conn(0x7f3c38068770 msgr2=0x7f3c380ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 shutdown_connections 2023-10-06T04:16:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.049+0000 7f3c3d984700 1 -- 172.21.15.37:0/2228689200 wait complete. 2023-10-06T04:16:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-10-06T04:16:52.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:52.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.179+0000 7f5dec365700 1 Processor -- start 2023-10-06T04:16:52.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.179+0000 7f5dec365700 1 -- start start 2023-10-06T04:16:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dec365700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5de415dc70 0x7f5de40ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dec365700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40b6200 0x7f5de40ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dec365700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40ae9f0 con 0x7f5de40b5e30 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dec365700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de40adb70 con 0x7f5de415dc70 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dec365700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40adde0 con 0x7f5de40b6200 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dea101700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5de40b5e30 0x7f5de415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35400/0 (socket says 172.21.15.37:35400) 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dea101700 1 -- 172.21.15.37:0/3048755798 learned_addr learned my addr 172.21.15.37:0/3048755798 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5dea902700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40b6200 0x7f5de40ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5de9900700 1 --2- 172.21.15.37:0/3048755798 >> v2:172.21.15.83:3300/0 conn(0x7f5de415dc70 0x7f5de40ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.180+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426097632 0 0) 0x7f5de40ae9f0 con 0x7f5de40b5e30 2023-10-06T04:16:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003570 con 0x7f5de40b5e30 2023-10-06T04:16:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3778394540 0 0) 0x7f5dcc003570 con 0x7f5de40b5e30 2023-10-06T04:16:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40b6200 msgr2=0x7f5de40ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40b6200 0x7f5de40ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 >> v2:172.21.15.83:3300/0 conn(0x7f5de415dc70 msgr2=0x7f5de40ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 --2- 172.21.15.37:0/3048755798 >> v2:172.21.15.83:3300/0 conn(0x7f5de415dc70 0x7f5de40ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40ae0c0 con 0x7f5de40b5e30 2023-10-06T04:16:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f5ddc001470 con 0x7f5de40b5e30 2023-10-06T04:16:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 >> v1:172.21.15.37:6789/0 conn(0x7f5de40b5e30 legacy=0x7f5de415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dcc003a60 0x7f5dcc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc004810 0x7f5dcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dcc0051c0 0x7f5dcc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40adb70 con 0x7f5dcc003a60 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40adde0 con 0x7f5dcc0051c0 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc00c020 con 0x7f5dcc004810 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea902700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5de40b6200 0x7f5de40ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dcc003a60 0x7f5dcc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5de9900700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc004810 0x7f5dcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea902700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dcc0051c0 0x7f5dcc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 -- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc004810 msgr2=0x7f5dcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc004810 0x7f5dcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 -- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dcc0051c0 msgr2=0x7f5dcc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dcc0051c0 0x7f5dcc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 -- 172.21.15.37:0/3048755798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc003570 con 0x7f5dcc003a60 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.181+0000 7f5dea101700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dcc003a60 0x7f5dcc003e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c3c0 tx=0x7f5ddc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96446539ef945672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00cc90 con 0x7f5dcc003a60 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00cdf0 con 0x7f5dcc003a60 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5de90ff700 1 -- 172.21.15.37:0/3048755798 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc005b70 con 0x7f5dcc003a60 2023-10-06T04:16:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 -- 172.21.15.37:0/3048755798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dcc003a60 msgr2=0x7f5dcc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 --2- 172.21.15.37:0/3048755798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dcc003a60 0x7f5dcc003e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c3c0 tx=0x7f5ddc001e90 comp rx=0 tx=0).stop 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dea902700 1 -- 172.21.15.37:0/3048755798 reap_dead start 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 -- 172.21.15.37:0/3048755798 shutdown_connections 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 -- 172.21.15.37:0/3048755798 >> 172.21.15.37:0/3048755798 conn(0x7f5de4099a10 msgr2=0x7f5de406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 -- 172.21.15.37:0/3048755798 shutdown_connections 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.182+0000 7f5dec365700 1 -- 172.21.15.37:0/3048755798 wait complete. 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.183+0000 7f5dec365700 1 Processor -- start 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.183+0000 7f5dec365700 1 -- start start 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc003a60 0x7f5de4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de416b250 0x7f5de416b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4154d20 con 0x7f5de416a080 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4151d50 con 0x7f5de416b250 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dec365700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4152310 con 0x7f5dcc003a60 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51866/0 (socket says 172.21.15.37:51866) 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea101700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc003a60 0x7f5de4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 -- 172.21.15.37:0/1043059482 learned_addr learned my addr 172.21.15.37:0/1043059482 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5de9900700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de416b250 0x7f5de416b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 -- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc003a60 msgr2=0x7f5de4150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc003a60 0x7f5de4150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 -- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de416b250 msgr2=0x7f5de416b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de416b250 0x7f5de416b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.184+0000 7f5dea902700 1 -- 172.21.15.37:0/1043059482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4150fd0 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5dea902700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b65d0 tx=0x7f5dd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400e070 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4011c50 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de416abb0 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4016470 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.185+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de4151fa0 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.186+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de40b2f90 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.186+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dd40167e0 con 0x7f5de416a080 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.187+0000 7f5de27fc700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 0x7f5dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.187+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5dd4084e70 con 0x7f5de416a080 2023-10-06T04:16:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.187+0000 7f5dea101700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 0x7f5dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.187+0000 7f5dea101700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 0x7f5dd00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc001ed0 tx=0x7f5ddc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.191+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dd40522d0 con 0x7f5de416a080 2023-10-06T04:16:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.385+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de4152480 con 0x7f5de416a080 2023-10-06T04:16:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.386+0000 7f5de27fc700 1 -- 172.21.15.37:0/1043059482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13599 (secure 0 0 0) 0x7f5dd40558f0 con 0x7f5de416a080 2023-10-06T04:16:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:52.388 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:51.607378+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 msgr2=0x7f5dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 0x7f5dd00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc001ed0 tx=0x7f5ddc015000 comp rx=0 tx=0).stop 2023-10-06T04:16:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 msgr2=0x7f5de416a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b65d0 tx=0x7f5dd400b040 comp rx=0 tx=0).stop 2023-10-06T04:16:52.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 shutdown_connections 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5de416a080 0x7f5de416a4f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5dcc003a60 0x7f5de4150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5dd0066f30 0x7f5dd00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 --2- 172.21.15.37:0/1043059482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5de416b250 0x7f5de416b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 >> 172.21.15.37:0/1043059482 conn(0x7f5de4099a10 msgr2=0x7f5de415afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 shutdown_connections 2023-10-06T04:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.388+0000 7f5dec365700 1 -- 172.21.15.37:0/1043059482 wait complete. 2023-10-06T04:16:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:16:52.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:16:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.522+0000 7f153634d700 1 Processor -- start 2023-10-06T04:16:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.522+0000 7f153634d700 1 -- start start 2023-10-06T04:16:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f153634d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f15300ce260 0x7f15300cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f153634d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f153634d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300cdb20 con 0x7f1530159dc0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f153634d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300cf9d0 con 0x7f15300ce260 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f153634d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b3090 con 0x7f15300ceff0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f152ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1530159dc0 0x7f15300ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35410/0 (socket says 172.21.15.37:35410) 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.523+0000 7f152ffff700 1 -- 172.21.15.37:0/2107319280 learned_addr learned my addr 172.21.15.37:0/2107319280 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f15348ea700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 --2- 172.21.15.37:0/2107319280 >> v2:172.21.15.83:3300/0 conn(0x7f15300ce260 0x7f15300cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746609319 0 0) 0x7f15300cdb20 con 0x7f1530159dc0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f151c003570 con 0x7f1530159dc0 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 -- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 msgr2=0x7f15300cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705105958 0 0) 0x7f151c003570 con 0x7f1530159dc0 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 -- 172.21.15.37:0/2107319280 >> v1:172.21.15.37:6789/0 conn(0x7f1530159dc0 legacy=0x7f15300ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 -- 172.21.15.37:0/2107319280 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300c5430 con 0x7f15300ce260 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f15348ea700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152f7fe700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f15300cc6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15180098e0 tx=0x7f15180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d628c0fa428b6413 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200015f0 con 0x7f15300ce260 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518011420 con 0x7f15300ce260 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.524+0000 7f152effd700 1 -- 172.21.15.37:0/2107319280 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180117a0 con 0x7f15300ce260 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 -- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 msgr2=0x7f15300cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f15300cc6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15180098e0 tx=0x7f15180091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 -- 172.21.15.37:0/2107319280 shutdown_connections 2023-10-06T04:16:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 --2- 172.21.15.37:0/2107319280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f15300cc6a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 -- 172.21.15.37:0/2107319280 >> 172.21.15.37:0/2107319280 conn(0x7f1530099a50 msgr2=0x7f153006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 -- 172.21.15.37:0/2107319280 shutdown_connections 2023-10-06T04:16:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.525+0000 7f153634d700 1 -- 172.21.15.37:0/2107319280 wait complete. 2023-10-06T04:16:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.526+0000 7f153634d700 1 Processor -- start 2023-10-06T04:16:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.526+0000 7f153634d700 1 -- start start 2023-10-06T04:16:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f1530157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300af1e0 con 0x7f1530159dc0 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300aeeb0 con 0x7f15300ce260 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f153634d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300c8b30 con 0x7f15300ceff0 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51882/0 (socket says 172.21.15.37:51882) 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 -- 172.21.15.37:0/2048121584 learned_addr learned my addr 172.21.15.37:0/2048121584 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f152f7fe700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f152ffff700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f1530157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 -- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 msgr2=0x7f15300c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 -- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 msgr2=0x7f1530157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f1530157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 -- 172.21.15.37:0/2048121584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009a20 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f15348ea700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1528009fc0 tx=0x7f152800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.527+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800cc80 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.528+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152800f040 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.528+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518009420 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.528+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528014480 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.528+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300c90f0 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.528+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153004c3c0 con 0x7f1530159dc0 2023-10-06T04:16:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.529+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1528003020 con 0x7f1530159dc0 2023-10-06T04:16:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.529+0000 7f1527fff700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.529+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1528084e70 con 0x7f1530159dc0 2023-10-06T04:16:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.529+0000 7f152ffff700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.530+0000 7f152ffff700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 0x7f15100693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1520001380 tx=0x7f1520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.534+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1528052230 con 0x7f1530159dc0 2023-10-06T04:16:52.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.729+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15300af320 con 0x7f1530159dc0 2023-10-06T04:16:52.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.730+0000 7f1527fff700 1 -- 172.21.15.37:0/2048121584 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1528055850 con 0x7f1530159dc0 2023-10-06T04:16:52.731 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:16:52.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 msgr2=0x7f15100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 0x7f15100693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1520001380 tx=0x7f1520009040 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 msgr2=0x7f15300c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1528009fc0 tx=0x7f152800b040 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 shutdown_connections 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1530159dc0 0x7f15300c93b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15300ce260 0x7f1530157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 --2- 172.21.15.37:0/2048121584 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15300ceff0 0x7f15300c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 >> 172.21.15.37:0/2048121584 conn(0x7f1530099a50 msgr2=0x7f15301590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 shutdown_connections 2023-10-06T04:16:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.732+0000 7f153634d700 1 -- 172.21.15.37:0/2048121584 wait complete. 2023-10-06T04:16:52.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:16:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.865+0000 7f91b4ed4700 1 Processor -- start 2023-10-06T04:16:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.865+0000 7f91b4ed4700 1 -- start start 2023-10-06T04:16:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91b4ed4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 0x7f91b00ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91b4ed4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91b4ed4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b00cdb20 con 0x7f91b00cf530 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91b4ed4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b00cf9d0 con 0x7f91b0159dc0 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91b4ed4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00b3090 con 0x7f91b00ce260 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91ae59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 0x7f91b00ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.866+0000 7f91add9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:47740/0 (socket says 172.21.15.37:47740) 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 -- 172.21.15.37:0/2497129161 learned_addr learned my addr 172.21.15.37:0/2497129161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91aed9d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f91b00cf530 0x7f91b00c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:40164/0 (socket says 172.21.15.37:40164) 2023-10-06T04:16:52.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91ae59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 0x7f91b00ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:51468/0 (socket says 172.21.15.37:51468) 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 -- 172.21.15.37:0/2497129161 >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 msgr2=0x7f91b00ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 --2- 172.21.15.37:0/2497129161 >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 0x7f91b00ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 -- 172.21.15.37:0/2497129161 >> v1:172.21.15.83:6789/0 conn(0x7f91b00cf530 legacy=0x7f91b00c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 -- 172.21.15.37:0/2497129161 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00c5430 con 0x7f91b00ce260 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91add9b700 1 --2- 172.21.15.37:0/2497129161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91980099b0 tx=0x7f9198009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b9b7ab1eac4db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91ad59a700 1 -- 172.21.15.37:0/2497129161 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198009ea0 con 0x7f91b00ce260 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91ad59a700 1 -- 172.21.15.37:0/2497129161 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800b860 con 0x7f91b00ce260 2023-10-06T04:16:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.867+0000 7f91ad59a700 1 -- 172.21.15.37:0/2497129161 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800bc00 con 0x7f91b00ce260 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 -- 172.21.15.37:0/2497129161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 msgr2=0x7f91b00ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/2497129161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91980099b0 tx=0x7f9198009250 comp rx=0 tx=0).stop 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 -- 172.21.15.37:0/2497129161 shutdown_connections 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/2497129161 >> v2:172.21.15.83:3300/0 conn(0x7f91b0159dc0 0x7f91b00ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/2497129161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00ceff0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 -- 172.21.15.37:0/2497129161 >> 172.21.15.37:0/2497129161 conn(0x7f91b0099a50 msgr2=0x7f91b006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 -- 172.21.15.37:0/2497129161 shutdown_connections 2023-10-06T04:16:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.868+0000 7f91b4ed4700 1 -- 172.21.15.37:0/2497129161 wait complete. 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.869+0000 7f91b4ed4700 1 Processor -- start 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.869+0000 7f91b4ed4700 1 -- start start 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91b0159dc0 0x7f91b0169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00c8d40 con 0x7f91b00cf530 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00c8130 con 0x7f91b0159dc0 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00c8410 con 0x7f91b00ce260 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51896/0 (socket says 172.21.15.37:51896) 2023-10-06T04:16:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 -- 172.21.15.37:0/1511752853 learned_addr learned my addr 172.21.15.37:0/1511752853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91aed9d700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91b0159dc0 0x7f91b0169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91ae59c700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 -- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 msgr2=0x7f91b00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 -- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91b0159dc0 msgr2=0x7f91b0169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91b0159dc0 0x7f91b0169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 -- 172.21.15.37:0/1511752853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980094f0 con 0x7f91b00cf530 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91add9b700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91b00b31d0 tx=0x7f9198017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198000d10 con 0x7f91b00cf530 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800b9d0 con 0x7f91b00cf530 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b00c86f0 con 0x7f91b00cf530 2023-10-06T04:16:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.870+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198025420 con 0x7f91b00cf530 2023-10-06T04:16:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.871+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b009c4c0 con 0x7f91b00cf530 2023-10-06T04:16:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.872+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b00c8eb0 con 0x7f91b00cf530 2023-10-06T04:16:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.872+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9198023070 con 0x7f91b00cf530 2023-10-06T04:16:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.872+0000 7f91a67fc700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.872+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9198085680 con 0x7f91b00cf530 2023-10-06T04:16:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.872+0000 7f91ae59c700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.873+0000 7f91ae59c700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 0x7f91900693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009d10 tx=0x7f91a8009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:52.876+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9198052b90 con 0x7f91b00cf530 2023-10-06T04:16:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.067+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91b004c3c0 con 0x7f91b00cf530 2023-10-06T04:16:53.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.067+0000 7f91a67fc700 1 -- 172.21.15.37:0/1511752853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91980561b0 con 0x7f91b00cf530 2023-10-06T04:16:53.069 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:16:53.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 msgr2=0x7f91900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 0x7f91900693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009d10 tx=0x7f91a8009120 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 msgr2=0x7f91b01698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91b00b31d0 tx=0x7f9198017000 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 shutdown_connections 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9190066f30 0x7f91900693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91b0159dc0 0x7f91b0169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91b00ce260 0x7f91b00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 --2- 172.21.15.37:0/1511752853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91b00cf530 0x7f91b01698d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 >> 172.21.15.37:0/1511752853 conn(0x7f91b0099a50 msgr2=0x7f91b00d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 shutdown_connections 2023-10-06T04:16:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.069+0000 7f91b4ed4700 1 -- 172.21.15.37:0/1511752853 wait complete. 2023-10-06T04:16:53.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:16:53.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.199+0000 7f83742ae700 1 Processor -- start 2023-10-06T04:16:53.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.199+0000 7f83742ae700 1 -- start start 2023-10-06T04:16:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f83742ae700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f836c150a90 0x7f836c06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f83742ae700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 0x7f836c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f83742ae700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c157a10 con 0x7f836c150e60 2023-10-06T04:16:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f83742ae700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c156ba0 con 0x7f836c150a90 2023-10-06T04:16:53.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f83742ae700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06efd0 con 0x7f836c0af4f0 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f837204a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f836c150a90 0x7f836c06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f8371849700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f836c150e60 0x7f836c0aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35424/0 (socket says 172.21.15.37:35424) 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.200+0000 7f8371849700 1 -- 172.21.15.37:0/451756413 learned_addr learned my addr 172.21.15.37:0/451756413 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837284b700 1 --2- 172.21.15.37:0/451756413 >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 0x7f836c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837204a700 1 -- 172.21.15.37:0/451756413 >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 msgr2=0x7f836c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837204a700 1 --2- 172.21.15.37:0/451756413 >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 0x7f836c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837204a700 1 -- 172.21.15.37:0/451756413 >> v1:172.21.15.37:6789/0 conn(0x7f836c150e60 legacy=0x7f836c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837204a700 1 -- 172.21.15.37:0/451756413 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c156e00 con 0x7f836c150a90 2023-10-06T04:16:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837284b700 1 --2- 172.21.15.37:0/451756413 >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 0x7f836c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f837204a700 1 --2- 172.21.15.37:0/451756413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c06f2d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f836c0b2da0 tx=0x7f83640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3abccc3d9744225 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f8371048700 1 -- 172.21.15.37:0/451756413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400b6b0 con 0x7f836c150a90 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f8371048700 1 -- 172.21.15.37:0/451756413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400b810 con 0x7f836c150a90 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.201+0000 7f8371048700 1 -- 172.21.15.37:0/451756413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400bbb0 con 0x7f836c150a90 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 -- 172.21.15.37:0/451756413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 msgr2=0x7f836c06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 --2- 172.21.15.37:0/451756413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c06f2d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f836c0b2da0 tx=0x7f83640091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 -- 172.21.15.37:0/451756413 shutdown_connections 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 --2- 172.21.15.37:0/451756413 >> v2:172.21.15.83:3300/0 conn(0x7f836c0af4f0 0x7f836c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 --2- 172.21.15.37:0/451756413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c06f2d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 -- 172.21.15.37:0/451756413 >> 172.21.15.37:0/451756413 conn(0x7f836c068770 msgr2=0x7f836c068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 -- 172.21.15.37:0/451756413 shutdown_connections 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.202+0000 7f83742ae700 1 -- 172.21.15.37:0/451756413 wait complete. 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.203+0000 7f83742ae700 1 Processor -- start 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.203+0000 7f83742ae700 1 -- start start 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 0x7f836c167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836c150e60 0x7f836c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c14f6e0 con 0x7f836c150a90 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c167cd0 con 0x7f836c150e60 2023-10-06T04:16:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c167a70 con 0x7f836c0af4f0 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51908/0 (socket says 172.21.15.37:51908) 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 -- 172.21.15.37:0/2669176530 learned_addr learned my addr 172.21.15.37:0/2669176530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f837204a700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 0x7f836c167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f837284b700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836c150e60 0x7f836c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 -- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 msgr2=0x7f836c167530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 0x7f836c167530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 -- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836c150e60 msgr2=0x7f836c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836c150e60 0x7f836c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 -- 172.21.15.37:0/2669176530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364009420 con 0x7f836c150a90 2023-10-06T04:16:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f837204a700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 0x7f836c167530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f8371849700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f836000c590 tx=0x7f8360007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360005b30 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360005cb0 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.204+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c1456a0 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.205+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360007320 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.205+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0ce0e0 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.205+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c063410 con 0x7f836c150a90 2023-10-06T04:16:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.206+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f836001c440 con 0x7f836c150a90 2023-10-06T04:16:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.206+0000 7f836a7fc700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 0x7f8358069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.206+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8360083690 con 0x7f836c150a90 2023-10-06T04:16:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.206+0000 7f837204a700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 0x7f8358069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.207+0000 7f837204a700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 0x7f8358069410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f836c06f640 tx=0x7f8364017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.210+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f836004b5a0 con 0x7f836c150a90 2023-10-06T04:16:53.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.408+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f836c06eaf0 con 0x7f836c150a90 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.408+0000 7f836a7fc700 1 -- 172.21.15.37:0/2669176530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8360050ba0 con 0x7f836c150a90 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:16:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:16:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T04:16:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T04:16:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:16:53.411 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 msgr2=0x7f8358069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 0x7f8358069410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f836c06f640 tx=0x7f8364017000 comp rx=0 tx=0).stop 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 msgr2=0x7f836c145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f836000c590 tx=0x7f8360007f70 comp rx=0 tx=0).stop 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 shutdown_connections 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8358066f60 0x7f8358069410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836c150e60 0x7f836c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836c0af4f0 0x7f836c167530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 --2- 172.21.15.37:0/2669176530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f836c150a90 0x7f836c145160 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 >> 172.21.15.37:0/2669176530 conn(0x7f836c068770 msgr2=0x7f836c155540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 shutdown_connections 2023-10-06T04:16:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.410+0000 7f83742ae700 1 -- 172.21.15.37:0/2669176530 wait complete. 2023-10-06T04:16:53.423 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:16:53.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:16:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.546+0000 7f2f578ef700 1 Processor -- start 2023-10-06T04:16:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.546+0000 7f2f578ef700 1 -- start start 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f578ef700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f50159da0 0x7f2f500c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f578ef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f500ceb50 0x7f2f500cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f578ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f500cf500 con 0x7f2f500cd020 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f578ef700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500cbb00 con 0x7f2f50159da0 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f578ef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f500cdc50 con 0x7f2f500ceb50 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f50159da0 0x7f2f500c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f50159da0 0x7f2f500c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51918/0 (socket says 172.21.15.37:51918) 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 -- 172.21.15.37:0/3810202976 learned_addr learned my addr 172.21.15.37:0/3810202976 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f54e8a700 1 --2- 172.21.15.37:0/3810202976 >> v2:172.21.15.83:3300/0 conn(0x7f2f500ceb50 0x7f2f500cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 -- 172.21.15.37:0/3810202976 >> v2:172.21.15.83:3300/0 conn(0x7f2f500ceb50 msgr2=0x7f2f500cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 --2- 172.21.15.37:0/3810202976 >> v2:172.21.15.83:3300/0 conn(0x7f2f500ceb50 0x7f2f500cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 -- 172.21.15.37:0/3810202976 >> v1:172.21.15.83:6789/0 conn(0x7f2f500cd020 legacy=0x7f2f500cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 -- 172.21.15.37:0/3810202976 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500cdf30 con 0x7f2f50159da0 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f5568b700 1 --2- 172.21.15.37:0/3810202976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f50159da0 0x7f2f500c5410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f500649d0 tx=0x7f2f40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f32ac6e9319b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.547+0000 7f2f4ffff700 1 -- 172.21.15.37:0/3810202976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000e070 con 0x7f2f50159da0 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f4ffff700 1 -- 172.21.15.37:0/3810202976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4000ba20 con 0x7f2f50159da0 2023-10-06T04:16:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f4ffff700 1 -- 172.21.15.37:0/3810202976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400092e0 con 0x7f2f50159da0 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 -- 172.21.15.37:0/3810202976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f50159da0 msgr2=0x7f2f500c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 --2- 172.21.15.37:0/3810202976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f50159da0 0x7f2f500c5410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f500649d0 tx=0x7f2f40009840 comp rx=0 tx=0).stop 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 -- 172.21.15.37:0/3810202976 shutdown_connections 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 --2- 172.21.15.37:0/3810202976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f50159da0 0x7f2f500c5410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 --2- 172.21.15.37:0/3810202976 >> v2:172.21.15.83:3300/0 conn(0x7f2f500ceb50 0x7f2f500cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 -- 172.21.15.37:0/3810202976 >> 172.21.15.37:0/3810202976 conn(0x7f2f50099aa0 msgr2=0x7f2f5006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 -- 172.21.15.37:0/3810202976 shutdown_connections 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.548+0000 7f2f578ef700 1 -- 172.21.15.37:0/3810202976 wait complete. 2023-10-06T04:16:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.549+0000 7f2f578ef700 1 Processor -- start 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.549+0000 7f2f578ef700 1 -- start start 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f500cd020 0x7f2f50150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f50159da0 0x7f2f500c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c8710 con 0x7f2f500ceb50 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f500c90b0 con 0x7f2f500cd020 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f578ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5014db90 con 0x7f2f50159da0 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51928/0 (socket says 172.21.15.37:51928) 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 -- 172.21.15.37:0/470877245 learned_addr learned my addr 172.21.15.37:0/470877245 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f5568b700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f500cd020 0x7f2f50150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f55e8c700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f50159da0 0x7f2f500c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 -- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f50159da0 msgr2=0x7f2f500c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f50159da0 0x7f2f500c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 -- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f500cd020 msgr2=0x7f2f50150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f500cd020 0x7f2f50150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.550+0000 7f2f54e8a700 1 -- 172.21.15.37:0/470877245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40009ae0 con 0x7f2f500ceb50 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f54e8a700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e960 tx=0x7f2f440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44013680 con 0x7f2f500ceb50 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f440137e0 con 0x7f2f500ceb50 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500c8430 con 0x7f2f500ceb50 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44013b80 con 0x7f2f500ceb50 2023-10-06T04:16:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.551+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f500c8d40 con 0x7f2f500ceb50 2023-10-06T04:16:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.552+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f500c88c0 con 0x7f2f500ceb50 2023-10-06T04:16:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.552+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f4400c490 con 0x7f2f500ceb50 2023-10-06T04:16:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.552+0000 7f2f4d7fa700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.553+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2f44084480 con 0x7f2f500ceb50 2023-10-06T04:16:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.553+0000 7f2f5568b700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.553+0000 7f2f5568b700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009fd0 tx=0x7f2f40018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.557+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f500c88c0 con 0x7f2f500ceb50 2023-10-06T04:16:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:53.750+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f500c88c0 con 0x7f2f500ceb50 2023-10-06T04:16:54.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:16:54.047 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:16:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.631+0000 7f2f4d7fa700 1 -- 172.21.15.37:0/470877245 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f500c88c0 con 0x7f2f500ceb50 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 msgr2=0x7f2f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 0x7f2f3c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009fd0 tx=0x7f2f40018000 comp rx=0 tx=0).stop 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 msgr2=0x7f2f500c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e960 tx=0x7f2f440091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 shutdown_connections 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f50159da0 0x7f2f500c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2f3c066f30 0x7f2f3c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f500cd020 0x7f2f50150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 --2- 172.21.15.37:0/470877245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f500ceb50 0x7f2f500c66c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 >> 172.21.15.37:0/470877245 conn(0x7f2f50099aa0 msgr2=0x7f2f50068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 shutdown_connections 2023-10-06T04:16:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.635+0000 7f2f578ef700 1 -- 172.21.15.37:0/470877245 wait complete. 2023-10-06T04:16:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T04:16:54.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:16:54.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.784+0000 7f8a59c76700 1 Processor -- start 2023-10-06T04:16:54.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.784+0000 7f8a59c76700 1 -- start start 2023-10-06T04:16:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a59c76700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a54159dc0 0x7f8a540ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a59c76700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 0x7f8a540ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a59c76700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a540cdb20 con 0x7f8a540cf530 2023-10-06T04:16:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a59c76700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a540cf9d0 con 0x7f8a54159dc0 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a59c76700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b3090 con 0x7f8a540ce260 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a537fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a54159dc0 0x7f8a540ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a537fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a54159dc0 0x7f8a540ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51940/0 (socket says 172.21.15.37:51940) 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.785+0000 7f8a537fe700 1 -- 172.21.15.37:0/1002869391 learned_addr learned my addr 172.21.15.37:0/1002869391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a52ffd700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 0x7f8a540ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a537fe700 1 -- 172.21.15.37:0/1002869391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 msgr2=0x7f8a540ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a537fe700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 0x7f8a540ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a537fe700 1 -- 172.21.15.37:0/1002869391 >> v1:172.21.15.83:6789/0 conn(0x7f8a540cf530 legacy=0x7f8a540c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a537fe700 1 -- 172.21.15.37:0/1002869391 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540c5430 con 0x7f8a54159dc0 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a52ffd700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 0x7f8a540ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a537fe700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a540ad140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009990 tx=0x7f8a44009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2036735d2fa60c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a527fc700 1 -- 172.21.15.37:0/1002869391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44005c10 con 0x7f8a54159dc0 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a527fc700 1 -- 172.21.15.37:0/1002869391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a44005d70 con 0x7f8a54159dc0 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a527fc700 1 -- 172.21.15.37:0/1002869391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400b840 con 0x7f8a54159dc0 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a59c76700 1 -- 172.21.15.37:0/1002869391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 msgr2=0x7f8a540ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.786+0000 7f8a59c76700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a540ad140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009990 tx=0x7f8a44009220 comp rx=0 tx=0).stop 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 -- 172.21.15.37:0/1002869391 shutdown_connections 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a540ad140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 --2- 172.21.15.37:0/1002869391 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540ce260 0x7f8a540ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 -- 172.21.15.37:0/1002869391 >> 172.21.15.37:0/1002869391 conn(0x7f8a54099a50 msgr2=0x7f8a5406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 -- 172.21.15.37:0/1002869391 shutdown_connections 2023-10-06T04:16:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.787+0000 7f8a59c76700 1 -- 172.21.15.37:0/1002869391 wait complete. 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.788+0000 7f8a59c76700 1 Processor -- start 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.788+0000 7f8a59c76700 1 -- start start 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.788+0000 7f8a59c76700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 0x7f8a5409d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.788+0000 7f8a59c76700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 0x7f8a5409aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.788+0000 7f8a59c76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a59c76700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5409dc10 con 0x7f8a54159dc0 2023-10-06T04:16:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a59c76700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5409b420 con 0x7f8a540ce260 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a59c76700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5409de40 con 0x7f8a540cf530 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51948/0 (socket says 172.21.15.37:51948) 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 -- 172.21.15.37:0/2183678422 learned_addr learned my addr 172.21.15.37:0/2183678422 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a52ffd700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 0x7f8a5409aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a537fe700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 0x7f8a5409d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 -- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 msgr2=0x7f8a5409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 0x7f8a5409aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 -- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 msgr2=0x7f8a5409d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 0x7f8a5409d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 -- 172.21.15.37:0/2183678422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44009480 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a52ffd700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 0x7f8a5409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a537fe700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 0x7f8a5409d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a53fff700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00bc30 tx=0x7f8a4c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00c9b0 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c00cb50 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5409e120 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c014410 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.789+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a54156300 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.790+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5404c3c0 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.791+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a4c014800 con 0x7f8a54159dc0 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.791+0000 7f8a3b7fe700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.791+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8a4c084560 con 0x7f8a54159dc0 2023-10-06T04:16:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.791+0000 7f8a537fe700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.792+0000 7f8a537fe700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 0x7f8a400693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a44003080 tx=0x7f8a44015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:54.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.796+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a4c04c5a0 con 0x7f8a54159dc0 2023-10-06T04:16:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:54.989+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8a54067fd0 con 0x7f8a54159dc0 2023-10-06T04:16:55.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.634+0000 7f8a3b7fe700 1 -- 172.21.15.37:0/2183678422 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8a4c0552e0 con 0x7f8a54159dc0 2023-10-06T04:16:55.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.639+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 msgr2=0x7f8a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:55.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.639+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 0x7f8a400693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a44003080 tx=0x7f8a44015000 comp rx=0 tx=0).stop 2023-10-06T04:16:55.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.639+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 msgr2=0x7f8a54069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:55.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.639+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00bc30 tx=0x7f8a4c009820 comp rx=0 tx=0).stop 2023-10-06T04:16:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 shutdown_connections 2023-10-06T04:16:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a54159dc0 0x7f8a54069a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8a540ce260 0x7f8a5409d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 --2- 172.21.15.37:0/2183678422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8a540cf530 0x7f8a5409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.646+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 >> 172.21.15.37:0/2183678422 conn(0x7f8a54099a50 msgr2=0x7f8a54068740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.651+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 shutdown_connections 2023-10-06T04:16:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.651+0000 7f8a59c76700 1 -- 172.21.15.37:0/2183678422 wait complete. 2023-10-06T04:16:55.654 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T04:16:55.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:16:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.791+0000 7fa881244700 1 Processor -- start 2023-10-06T04:16:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.791+0000 7fa881244700 1 -- start start 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa881244700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 0x7fa87c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa881244700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa87c159880 0x7fa87c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa881244700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0af990 con 0x7fa87c0b2190 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa881244700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0b2c90 con 0x7fa87c159880 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa881244700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0cd980 con 0x7fa87c1594b0 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa87c159880 0x7fa87c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa87c159880 0x7fa87c0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51964/0 (socket says 172.21.15.37:51964) 2023-10-06T04:16:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 -- 172.21.15.37:0/3715231105 learned_addr learned my addr 172.21.15.37:0/3715231105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87bfff700 1 --2- 172.21.15.37:0/3715231105 >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 0x7fa87c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 -- 172.21.15.37:0/3715231105 >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 msgr2=0x7fa87c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 --2- 172.21.15.37:0/3715231105 >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 0x7fa87c0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 -- 172.21.15.37:0/3715231105 >> v1:172.21.15.83:6789/0 conn(0x7fa87c0b2190 legacy=0x7fa87c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 -- 172.21.15.37:0/3715231105 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0b0d20 con 0x7fa87c159880 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87bfff700 1 --2- 172.21.15.37:0/3715231105 >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 0x7fa87c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.792+0000 7fa87b7fe700 1 --2- 172.21.15.37:0/3715231105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c159880 0x7fa87c0b0130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0d02c0 tx=0x7fa86c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe230848e36196eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa87affd700 1 -- 172.21.15.37:0/3715231105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00b820 con 0x7fa87c159880 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa87affd700 1 -- 172.21.15.37:0/3715231105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00b980 con 0x7fa87c159880 2023-10-06T04:16:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa87affd700 1 -- 172.21.15.37:0/3715231105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00bd20 con 0x7fa87c159880 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 -- 172.21.15.37:0/3715231105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c159880 msgr2=0x7fa87c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 --2- 172.21.15.37:0/3715231105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c159880 0x7fa87c0b0130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0d02c0 tx=0x7fa86c009250 comp rx=0 tx=0).stop 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 -- 172.21.15.37:0/3715231105 shutdown_connections 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 --2- 172.21.15.37:0/3715231105 >> v2:172.21.15.83:3300/0 conn(0x7fa87c1594b0 0x7fa87c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 --2- 172.21.15.37:0/3715231105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c159880 0x7fa87c0b0130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 -- 172.21.15.37:0/3715231105 >> 172.21.15.37:0/3715231105 conn(0x7fa87c06ed90 msgr2=0x7fa87c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 -- 172.21.15.37:0/3715231105 shutdown_connections 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.793+0000 7fa881244700 1 -- 172.21.15.37:0/3715231105 wait complete. 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.794+0000 7fa881244700 1 Processor -- start 2023-10-06T04:16:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 -- start start 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa87c0b2190 0x7fa87c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa87c159880 0x7fa87c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15d770 con 0x7fa87c1594b0 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0c5bf0 con 0x7fa87c159880 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa881244700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0c5ed0 con 0x7fa87c0b2190 2023-10-06T04:16:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51972/0 (socket says 172.21.15.37:51972) 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa87b7fe700 1 -- 172.21.15.37:0/2206629322 learned_addr learned my addr 172.21.15.37:0/2206629322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa880a43700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa87c159880 0x7fa87c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.795+0000 7fa87bfff700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa87c0b2190 0x7fa87c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 -- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa87c0b2190 msgr2=0x7fa87c0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa87c0b2190 0x7fa87c0c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 -- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa87c159880 msgr2=0x7fa87c14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa87c159880 0x7fa87c14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 -- 172.21.15.37:0/2206629322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0094f0 con 0x7fa87c1594b0 2023-10-06T04:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa87b7fe700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0030c0 tx=0x7fa86c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c011d00 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c020070 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c0c61b0 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c01b6a0 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.796+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c0c6770 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.797+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0c6960 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.797+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa86c022030 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.798+0000 7fa873fff700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.798+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fa86c086450 con 0x7fa87c1594b0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.798+0000 7fa87bfff700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.799+0000 7fa87bfff700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa86400adc0 tx=0x7fa864006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:55.803+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa86c0535c0 con 0x7fa87c1594b0 2023-10-06T04:16:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.045+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa87c0c6960 con 0x7fa87c1594b0 2023-10-06T04:16:56.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.683+0000 7fa873fff700 1 -- 172.21.15.37:0/2206629322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa86c056be0 con 0x7fa87c1594b0 2023-10-06T04:16:56.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 msgr2=0x7fa85c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 0x7fa85c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa86400adc0 tx=0x7fa864006f90 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 msgr2=0x7fa87c15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0030c0 tx=0x7fa86c016000 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 shutdown_connections 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa85c066f30 0x7fa85c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa87c159880 0x7fa87c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa87c0b2190 0x7fa87c0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 --2- 172.21.15.37:0/2206629322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87c1594b0 0x7fa87c15d230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.687+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 >> 172.21.15.37:0/2206629322 conn(0x7fa87c06ed90 msgr2=0x7fa87c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.688+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 shutdown_connections 2023-10-06T04:16:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.688+0000 7fa881244700 1 -- 172.21.15.37:0/2206629322 wait complete. 2023-10-06T04:16:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:16:56.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:56.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.825+0000 7f721f18c700 1 Processor -- start 2023-10-06T04:16:56.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.825+0000 7f721f18c700 1 -- start start 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721f18c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f721815dc70 0x7f72180ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721f18c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721f18c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180ae9f0 con 0x7f72180b5e30 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721f18c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72180adb70 con 0x7f721815dc70 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721f18c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180adde0 con 0x7f72180b6200 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721cf28700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72180b5e30 0x7f721815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55062/0 (socket says 172.21.15.37:55062) 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.826+0000 7f721cf28700 1 -- 172.21.15.37:0/4165295834 learned_addr learned my addr 172.21.15.37:0/4165295834 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 --2- 172.21.15.37:0/4165295834 >> v2:172.21.15.83:3300/0 conn(0x7f721815dc70 0x7f72180ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f721d729700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f72177fe700 1 -- 172.21.15.37:0/4165295834 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217386530 0 0) 0x7f72180ae9f0 con 0x7f72180b5e30 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f72177fe700 1 -- 172.21.15.37:0/4165295834 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7200003570 con 0x7f72180b5e30 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 -- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 msgr2=0x7f72180ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 -- 172.21.15.37:0/4165295834 >> v1:172.21.15.37:6789/0 conn(0x7f72180b5e30 legacy=0x7f721815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 -- 172.21.15.37:0/4165295834 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180ae0c0 con 0x7f721815dc70 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f721d729700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f7217fff700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f721815dc70 0x7f72180ad0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f720c0098e0 tx=0x7f720c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0229f40a1bbfba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f72177fe700 1 -- 172.21.15.37:0/4165295834 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011630 con 0x7f721815dc70 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f72177fe700 1 -- 172.21.15.37:0/4165295834 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c011790 con 0x7f721815dc70 2023-10-06T04:16:56.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.827+0000 7f72177fe700 1 -- 172.21.15.37:0/4165295834 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011b30 con 0x7f721815dc70 2023-10-06T04:16:56.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 -- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f721815dc70 msgr2=0x7f72180ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f721815dc70 0x7f72180ad0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f720c0098e0 tx=0x7f720c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 -- 172.21.15.37:0/4165295834 shutdown_connections 2023-10-06T04:16:56.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 --2- 172.21.15.37:0/4165295834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f721815dc70 0x7f72180ad0f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 -- 172.21.15.37:0/4165295834 >> 172.21.15.37:0/4165295834 conn(0x7f7218099a10 msgr2=0x7f721806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 -- 172.21.15.37:0/4165295834 shutdown_connections 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.828+0000 7f721f18c700 1 -- 172.21.15.37:0/4165295834 wait complete. 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.829+0000 7f721f18c700 1 Processor -- start 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.829+0000 7f721f18c700 1 -- start start 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72180b5e30 0x7f7218148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72181488d0 con 0x7f721815dc70 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721816b2b0 con 0x7f72180b5e30 2023-10-06T04:16:56.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721f18c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721816b0f0 con 0x7f72180b6200 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54212/0 (socket says 172.21.15.37:54212) 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 -- 172.21.15.37:0/854617713 learned_addr learned my addr 172.21.15.37:0/854617713 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f7217fff700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721cf28700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72180b5e30 0x7f7218148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 -- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 msgr2=0x7f72180af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 -- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72180b5e30 msgr2=0x7f7218148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72180b5e30 0x7f7218148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 -- 172.21.15.37:0/854617713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208009420 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f721d729700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f720800ec50 tx=0x7f72080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.830+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800c7f0 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.831+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720800c950 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.831+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800cd10 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.831+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c009420 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.831+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721809c360 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.831+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721809c1c0 con 0x7f721815dc70 2023-10-06T04:16:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.832+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7208013680 con 0x7f721815dc70 2023-10-06T04:16:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.832+0000 7f7214ff9700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 0x7f72040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.832+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72080848c0 con 0x7f721815dc70 2023-10-06T04:16:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.832+0000 7f721cf28700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 0x7f72040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.833+0000 7f721cf28700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 0x7f72040693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72180b06b0 tx=0x7f7210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:56.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:56.837+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f721809c1c0 con 0x7f721815dc70 2023-10-06T04:16:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.031+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f721809c1c0 con 0x7f721815dc70 2023-10-06T04:16:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.032+0000 7f7214ff9700 1 -- 172.21.15.37:0/854617713 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f721809c1c0 con 0x7f721815dc70 2023-10-06T04:16:57.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:57.035 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:56.046617+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 msgr2=0x7f72040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 0x7f72040693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72180b06b0 tx=0x7f7210009040 comp rx=0 tx=0).stop 2023-10-06T04:16:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 msgr2=0x7f72180afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f720800ec50 tx=0x7f72080091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 shutdown_connections 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f721815dc70 0x7f72180afd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7204066f30 0x7f72040693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72180b5e30 0x7f7218148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 --2- 172.21.15.37:0/854617713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f72180b6200 0x7f72180af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 >> 172.21.15.37:0/854617713 conn(0x7f7218099a10 msgr2=0x7f72180b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 shutdown_connections 2023-10-06T04:16:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.034+0000 7f721f18c700 1 -- 172.21.15.37:0/854617713 wait complete. 2023-10-06T04:16:57.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:16:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.167+0000 7f0e0d7f7700 1 Processor -- start 2023-10-06T04:16:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.167+0000 7f0e0d7f7700 1 -- start start 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e081539c0 0x7f0e08159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e08153d90 0x7f0e080b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e080d02e0 0x7f0e080d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080d0cc0 con 0x7f0e081539c0 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080b5ff0 con 0x7f0e080d02e0 2023-10-06T04:16:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e0d7f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b53e0 con 0x7f0e08153d90 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e081539c0 0x7f0e08159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e081539c0 0x7f0e08159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54226/0 (socket says 172.21.15.37:54226) 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 -- 172.21.15.37:0/3312461279 learned_addr learned my addr 172.21.15.37:0/3312461279 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e077fe700 1 --2- 172.21.15.37:0/3312461279 >> v2:172.21.15.83:3300/0 conn(0x7f0e080d02e0 0x7f0e080d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e067fc700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e08153d90 0x7f0e080b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 -- 172.21.15.37:0/3312461279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e08153d90 msgr2=0x7f0e080b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e08153d90 0x7f0e080b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 -- 172.21.15.37:0/3312461279 >> v2:172.21.15.83:3300/0 conn(0x7f0e080d02e0 msgr2=0x7f0e080d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/3312461279 >> v2:172.21.15.83:3300/0 conn(0x7f0e080d02e0 0x7f0e080d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.168+0000 7f0e06ffd700 1 -- 172.21.15.37:0/3312461279 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080b56c0 con 0x7f0e081539c0 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e081539c0 0x7f0e08159b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e080d1260 tx=0x7f0e00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60fe8b084af0095 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e05ffb700 1 -- 172.21.15.37:0/3312461279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000e070 con 0x7f0e081539c0 2023-10-06T04:16:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e05ffb700 1 -- 172.21.15.37:0/3312461279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0000b970 con 0x7f0e081539c0 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e05ffb700 1 -- 172.21.15.37:0/3312461279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e000092e0 con 0x7f0e081539c0 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/3312461279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e081539c0 msgr2=0x7f0e08159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e081539c0 0x7f0e08159b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e080d1260 tx=0x7f0e00009840 comp rx=0 tx=0).stop 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/3312461279 shutdown_connections 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/3312461279 >> v2:172.21.15.83:3300/0 conn(0x7f0e080d02e0 0x7f0e080d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e081539c0 0x7f0e08159b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/3312461279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e08153d90 0x7f0e080b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/3312461279 >> 172.21.15.37:0/3312461279 conn(0x7f0e0806ed90 msgr2=0x7f0e0806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/3312461279 shutdown_connections 2023-10-06T04:16:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.169+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/3312461279 wait complete. 2023-10-06T04:16:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.170+0000 7f0e0d7f7700 1 Processor -- start 2023-10-06T04:16:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.170+0000 7f0e0d7f7700 1 -- start start 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e081539c0 0x7f0e08157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e08153d90 0x7f0e081578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08159680 con 0x7f0e080d02e0 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08158a70 con 0x7f0e08153d90 2023-10-06T04:16:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e0d7f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08158d50 con 0x7f0e081539c0 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54230/0 (socket says 172.21.15.37:54230) 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e06ffd700 1 -- 172.21.15.37:0/1525896418 learned_addr learned my addr 172.21.15.37:0/1525896418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e067fc700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e081539c0 0x7f0e08157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.171+0000 7f0e077fe700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e08153d90 0x7f0e081578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 -- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e081539c0 msgr2=0x7f0e08157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e081539c0 0x7f0e08157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 -- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e08153d90 msgr2=0x7f0e081578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e08153d90 0x7f0e081578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 -- 172.21.15.37:0/1525896418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00009ae0 con 0x7f0e080d02e0 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e06ffd700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e08067fe0 tx=0x7f0e00018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e000087f0 con 0x7f0e080d02e0 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00008950 con 0x7f0e080d02e0 2023-10-06T04:16:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e08159030 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00008d10 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.172+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e08156f30 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.173+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0804c3c0 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.173+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e00003040 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.174+0000 7f0dfeffd700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 0x7f0de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.174+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e000861b0 con 0x7f0e080d02e0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.174+0000 7f0e067fc700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 0x7f0de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.174+0000 7f0e067fc700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 0x7f0de80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e081583a0 tx=0x7f0df00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.178+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e000532c0 con 0x7f0e080d02e0 2023-10-06T04:16:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.372+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e080aff80 con 0x7f0e080d02e0 2023-10-06T04:16:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.373+0000 7f0dfeffd700 1 -- 172.21.15.37:0/1525896418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f0e000568e0 con 0x7f0e080d02e0 2023-10-06T04:16:57.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:16:57.375 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:56.046617+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 msgr2=0x7f0de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 0x7f0de80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e081583a0 tx=0x7f0df00091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 msgr2=0x7f0e081569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e08067fe0 tx=0x7f0e00018000 comp rx=0 tx=0).stop 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 shutdown_connections 2023-10-06T04:16:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0de8066f30 0x7f0de80693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e08153d90 0x7f0e081578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080d02e0 0x7f0e081569f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 --2- 172.21.15.37:0/1525896418 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e081539c0 0x7f0e08157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 >> 172.21.15.37:0/1525896418 conn(0x7f0e0806ed90 msgr2=0x7f0e080af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 shutdown_connections 2023-10-06T04:16:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.375+0000 7f0e0d7f7700 1 -- 172.21.15.37:0/1525896418 wait complete. 2023-10-06T04:16:57.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:16:57.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.509+0000 7f08b50ac700 1 Processor -- start 2023-10-06T04:16:57.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.509+0000 7f08b50ac700 1 -- start start 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08b50ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 0x7f08b0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08b50ac700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00b51a0 con 0x7f08b0153d90 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08b50ac700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00b5ff0 con 0x7f08b00d02e0 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08b50ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00b53e0 con 0x7f08b01539c0 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08af7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08b0153d90 0x7f08b00b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55072/0 (socket says 172.21.15.37:55072) 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08af7fe700 1 -- 172.21.15.37:0/878463569 learned_addr learned my addr 172.21.15.37:0/878463569 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08affff700 1 --2- 172.21.15.37:0/878463569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 0x7f08b0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.510+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302500983 0 0) 0x7f0898001110 con 0x7f08b0153d90 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f089c003570 con 0x7f08b0153d90 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604498833 0 0) 0x7f08b00b5ff0 con 0x7f08b00d02e0 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0898001110 con 0x7f08b00d02e0 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08affff700 1 -- 172.21.15.37:0/878463569 >> v1:172.21.15.83:6789/0 conn(0x7f08b00d02e0 legacy=0x7f08b0163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08affff700 1 -- 172.21.15.37:0/878463569 >> v1:172.21.15.37:6789/0 conn(0x7f08b0153d90 legacy=0x7f08b00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08affff700 1 -- 172.21.15.37:0/878463569 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00b56c0 con 0x7f08b01539c0 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08affff700 1 --2- 172.21.15.37:0/878463569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 0x7f08b0159b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009910 tx=0x7f08a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6482428fb60b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0011630 con 0x7f08b01539c0 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0011790 con 0x7f08b01539c0 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.511+0000 7f08aeffd700 1 -- 172.21.15.37:0/878463569 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0011b30 con 0x7f08b01539c0 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 -- 172.21.15.37:0/878463569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 msgr2=0x7f08b0159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 --2- 172.21.15.37:0/878463569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 0x7f08b0159b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009910 tx=0x7f08a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 -- 172.21.15.37:0/878463569 shutdown_connections 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 --2- 172.21.15.37:0/878463569 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b01539c0 0x7f08b0159b00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 -- 172.21.15.37:0/878463569 >> 172.21.15.37:0/878463569 conn(0x7f08b006ed90 msgr2=0x7f08b006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 -- 172.21.15.37:0/878463569 shutdown_connections 2023-10-06T04:16:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.512+0000 7f08b50ac700 1 -- 172.21.15.37:0/878463569 wait complete. 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.513+0000 7f08b50ac700 1 Processor -- start 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.513+0000 7f08b50ac700 1 -- start start 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08b01539c0 0x7f08b015f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b0153d90 0x7f08b015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b016b300 con 0x7f08b00d02e0 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b016b5c0 con 0x7f08b01539c0 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b016b8a0 con 0x7f08b0153d90 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54238/0 (socket says 172.21.15.37:54238) 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 -- 172.21.15.37:0/3247788335 learned_addr learned my addr 172.21.15.37:0/3247788335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08af7fe700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08b01539c0 0x7f08b015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b48ab700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b0153d90 0x7f08b015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 -- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b0153d90 msgr2=0x7f08b015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b0153d90 0x7f08b015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 -- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08b01539c0 msgr2=0x7f08b015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08b01539c0 0x7f08b015f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 -- 172.21.15.37:0/3247788335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0009420 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08affff700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009f00 tx=0x7f08a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a001f070 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0000bc0 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.514+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b016bb80 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.515+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0025420 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.515+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b016d880 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.515+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b016bd90 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.516+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08a0023070 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.516+0000 7f08a7fff700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.516+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f08a0085980 con 0x7f08b00d02e0 2023-10-06T04:16:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.516+0000 7f08af7fe700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.517+0000 7f08af7fe700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 0x7f08900693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08b01527d0 tx=0x7f0898009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.520+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08a0052a90 con 0x7f08b00d02e0 2023-10-06T04:16:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:57.761+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f08b004c3c0 con 0x7f08b00d02e0 2023-10-06T04:16:58.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.691+0000 7f08a7fff700 1 -- 172.21.15.37:0/3247788335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f08a002a0b0 con 0x7f08b00d02e0 2023-10-06T04:16:58.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 msgr2=0x7f08900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 0x7f08900693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08b01527d0 tx=0x7f0898009040 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 msgr2=0x7f08b0141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009f00 tx=0x7f08a0017000 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 shutdown_connections 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08b0153d90 0x7f08b015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b00d02e0 0x7f08b0141d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0890066f30 0x7f08900693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 --2- 172.21.15.37:0/3247788335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08b01539c0 0x7f08b015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 >> 172.21.15.37:0/3247788335 conn(0x7f08b006ed90 msgr2=0x7f08b00cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 shutdown_connections 2023-10-06T04:16:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.694+0000 7f08b50ac700 1 -- 172.21.15.37:0/3247788335 wait complete. 2023-10-06T04:16:58.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:16:58.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.838+0000 7f85c0337700 1 Processor -- start 2023-10-06T04:16:58.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.838+0000 7f85c0337700 1 -- start start 2023-10-06T04:16:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85c0337700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 0x7f85b80ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85c0337700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80cdb20 con 0x7f85b80ce260 2023-10-06T04:16:58.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85c0337700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80c5430 con 0x7f85b80cf700 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85c0337700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b80b3090 con 0x7f85b8159dc0 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85bd8d2700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85b80ce260 0x7f85b80ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55078/0 (socket says 172.21.15.37:55078) 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85bd8d2700 1 -- 172.21.15.37:0/2233288348 learned_addr learned my addr 172.21.15.37:0/2233288348 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.839+0000 7f85be0d3700 1 --2- 172.21.15.37:0/2233288348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 0x7f85b80ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076429304 0 0) 0x7f85b80cdb20 con 0x7f85b80ce260 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a0003570 con 0x7f85b80ce260 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190082758 0 0) 0x7f85b80c5430 con 0x7f85b80cf700 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b80cdb20 con 0x7f85b80cf700 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85be0d3700 1 -- 172.21.15.37:0/2233288348 >> v1:172.21.15.83:6789/0 conn(0x7f85b80cf700 legacy=0x7f85b80c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85be0d3700 1 -- 172.21.15.37:0/2233288348 >> v1:172.21.15.37:6789/0 conn(0x7f85b80ce260 legacy=0x7f85b80ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85be0d3700 1 -- 172.21.15.37:0/2233288348 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80c6290 con 0x7f85b8159dc0 2023-10-06T04:16:58.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85be0d3700 1 --2- 172.21.15.37:0/2233288348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 0x7f85b80ad140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6979b8c3c6e528a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0005c10 con 0x7f85b8159dc0 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0005d70 con 0x7f85b8159dc0 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.840+0000 7f85bd0d1700 1 -- 172.21.15.37:0/2233288348 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0006260 con 0x7f85b8159dc0 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 -- 172.21.15.37:0/2233288348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 msgr2=0x7f85b80ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 --2- 172.21.15.37:0/2233288348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 0x7f85b80ad140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b0009120 comp rx=0 tx=0).stop 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 -- 172.21.15.37:0/2233288348 shutdown_connections 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 --2- 172.21.15.37:0/2233288348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b8159dc0 0x7f85b80ad140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 -- 172.21.15.37:0/2233288348 >> 172.21.15.37:0/2233288348 conn(0x7f85b8099a50 msgr2=0x7f85b806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 -- 172.21.15.37:0/2233288348 shutdown_connections 2023-10-06T04:16:58.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.841+0000 7f85c0337700 1 -- 172.21.15.37:0/2233288348 wait complete. 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.842+0000 7f85c0337700 1 Processor -- start 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.842+0000 7f85c0337700 1 -- start start 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b80cf700 0x7f85b816a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85b8159dc0 0x7f85b8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b809a2e0 con 0x7f85b80ce260 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b816ab50 con 0x7f85b8159dc0 2023-10-06T04:16:58.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b809c770 con 0x7f85b80cf700 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54246/0 (socket says 172.21.15.37:54246) 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 -- 172.21.15.37:0/2254870445 learned_addr learned my addr 172.21.15.37:0/2254870445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 -- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b80cf700 msgr2=0x7f85b816a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b80cf700 0x7f85b816a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 -- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85b8159dc0 msgr2=0x7f85b8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85b8159dc0 0x7f85b8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 -- 172.21.15.37:0/2254870445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00093c0 con 0x7f85b80ce260 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85be0d3700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009160 tx=0x7f85b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b001d970 con 0x7f85b80ce260 2023-10-06T04:16:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b001dad0 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b809ca50 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.843+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b001de90 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.844+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b809d010 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.844+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b804c3c0 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.845+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85b001b690 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.845+0000 7f85b67fc700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 0x7f85a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.845+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85b00863e0 con 0x7f85b80ce260 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.846+0000 7f85bd8d2700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 0x7f85a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:58.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.846+0000 7f85bd8d2700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 0x7f85a40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0058d0 tx=0x7f85ac0079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:58.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:58.849+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85b0053450 con 0x7f85b80ce260 2023-10-06T04:16:59.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.086+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f85b8067fd0 con 0x7f85b80ce260 2023-10-06T04:16:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.695+0000 7f85b67fc700 1 -- 172.21.15.37:0/2254870445 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85b0009220 con 0x7f85b80ce260 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 msgr2=0x7f85a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 0x7f85a40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0058d0 tx=0x7f85ac0079f0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 msgr2=0x7f85b809c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009160 tx=0x7f85b0016000 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 shutdown_connections 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f85a4066f30 0x7f85a40693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85b8159dc0 0x7f85b8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b80ce260 0x7f85b809c0e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 --2- 172.21.15.37:0/2254870445 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f85b80cf700 0x7f85b816a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 >> 172.21.15.37:0/2254870445 conn(0x7f85b8099a50 msgr2=0x7f85b80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 shutdown_connections 2023-10-06T04:16:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.698+0000 7f85c0337700 1 -- 172.21.15.37:0/2254870445 wait complete. 2023-10-06T04:16:59.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:16:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.838+0000 7f54bca37700 1 Processor -- start 2023-10-06T04:16:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.838+0000 7f54bca37700 1 -- start start 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54bca37700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54b80b5e30 0x7f54b815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54bca37700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80ad800 0x7f54b815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54bca37700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80ae9f0 con 0x7f54b80b6200 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54bca37700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80adde0 con 0x7f54b80b5e30 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54bca37700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80ae0c0 con 0x7f54b80ad800 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54b80b5e30 0x7f54b815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54b80b5e30 0x7f54b815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54248/0 (socket says 172.21.15.37:54248) 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 -- 172.21.15.37:0/1983787025 learned_addr learned my addr 172.21.15.37:0/1983787025 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b6d9d700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80ad800 0x7f54b815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 -- 172.21.15.37:0/1983787025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80ad800 msgr2=0x7f54b815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80ad800 0x7f54b815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 -- 172.21.15.37:0/1983787025 >> v1:172.21.15.83:6789/0 conn(0x7f54b80b6200 legacy=0x7f54b80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.839+0000 7f54b659c700 1 -- 172.21.15.37:0/1983787025 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80ae3a0 con 0x7f54b80b5e30 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54b659c700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b5e30 0x7f54b815d560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009f20 tx=0x7f54a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09c398c1e9e9c87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54b559a700 1 -- 172.21.15.37:0/1983787025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800e070 con 0x7f54b80b5e30 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54b559a700 1 -- 172.21.15.37:0/1983787025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800ba40 con 0x7f54b80b5e30 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54b559a700 1 -- 172.21.15.37:0/1983787025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80092e0 con 0x7f54b80b5e30 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 -- 172.21.15.37:0/1983787025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b5e30 msgr2=0x7f54b815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b5e30 0x7f54b815d560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009f20 tx=0x7f54a8009840 comp rx=0 tx=0).stop 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 -- 172.21.15.37:0/1983787025 shutdown_connections 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80ad800 0x7f54b815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 --2- 172.21.15.37:0/1983787025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b5e30 0x7f54b815d560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 -- 172.21.15.37:0/1983787025 >> 172.21.15.37:0/1983787025 conn(0x7f54b8099a10 msgr2=0x7f54b806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 -- 172.21.15.37:0/1983787025 shutdown_connections 2023-10-06T04:16:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.840+0000 7f54bca37700 1 -- 172.21.15.37:0/1983787025 wait complete. 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.841+0000 7f54bca37700 1 Processor -- start 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.841+0000 7f54bca37700 1 -- start start 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80b5e30 0x7f54b813f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54b80b6200 0x7f54b816d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b816a410 con 0x7f54b80ad800 2023-10-06T04:16:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8169e30 con 0x7f54b80b6200 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54bca37700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b816ade0 con 0x7f54b80b5e30 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54260/0 (socket says 172.21.15.37:54260) 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 -- 172.21.15.37:0/1841191502 learned_addr learned my addr 172.21.15.37:0/1841191502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b6d9d700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54b80b6200 0x7f54b816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b5d9b700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80b5e30 0x7f54b813f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 -- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80b5e30 msgr2=0x7f54b813f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80b5e30 0x7f54b813f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.842+0000 7f54b659c700 1 -- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54b80b6200 msgr2=0x7f54b816d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54b659c700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54b80b6200 0x7f54b816d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:16:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54b659c700 1 -- 172.21.15.37:0/1841191502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009ae0 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54b659c700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54a800bee0 tx=0x7f54a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8012a30 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8012b90 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b816de70 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a801d420 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.843+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b816a0a0 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.844+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b816e390 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.844+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54a801d850 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.845+0000 7f54a67fc700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 0x7f54980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.845+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54a80860b0 con 0x7f54b80ad800 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.845+0000 7f54b5d9b700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 0x7f54980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:16:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.845+0000 7f54b5d9b700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 0x7f54980693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006fd0 tx=0x7f54ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:16:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:16:59.849+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54b816e390 con 0x7f54b80ad800 2023-10-06T04:17:00.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.089+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54b816e390 con 0x7f54b80ad800 2023-10-06T04:17:00.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.090+0000 7f54a67fc700 1 -- 172.21.15.37:0/1841191502 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f54b816e390 con 0x7f54b80ad800 2023-10-06T04:17:00.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:00.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:00.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 msgr2=0x7f54980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 0x7f54980693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006fd0 tx=0x7f54ac008040 comp rx=0 tx=0).stop 2023-10-06T04:17:00.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 msgr2=0x7f54b816a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54a800bee0 tx=0x7f54a8017000 comp rx=0 tx=0).stop 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 shutdown_connections 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5498066f30 0x7f54980693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54b80b6200 0x7f54b816d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80ad800 0x7f54b816a8a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 --2- 172.21.15.37:0/1841191502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54b80b5e30 0x7f54b813f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 >> 172.21.15.37:0/1841191502 conn(0x7f54b8099a10 msgr2=0x7f54b815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 shutdown_connections 2023-10-06T04:17:00.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.092+0000 7f54bca37700 1 -- 172.21.15.37:0/1841191502 wait complete. 2023-10-06T04:17:00.095 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:00.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.222+0000 7f90f2aa9700 1 Processor -- start 2023-10-06T04:17:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.222+0000 7f90f2aa9700 1 -- start start 2023-10-06T04:17:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f2aa9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90ec0b6200 0x7f90ec0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f2aa9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0ae9f0 con 0x7f90ec0b5e30 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f2aa9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0adde0 con 0x7f90ec15dc70 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f2aa9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0ae0c0 con 0x7f90ec0b6200 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f1046700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90ec0b6200 0x7f90ec0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f0845700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90ec0b5e30 0x7f90ec15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55094/0 (socket says 172.21.15.37:55094) 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.223+0000 7f90f0845700 1 -- 172.21.15.37:0/3211861665 learned_addr learned my addr 172.21.15.37:0/3211861665 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f1046700 1 -- 172.21.15.37:0/3211861665 >> v1:172.21.15.83:6789/0 conn(0x7f90ec15dc70 legacy=0x7f90ec0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f1046700 1 -- 172.21.15.37:0/3211861665 >> v1:172.21.15.37:6789/0 conn(0x7f90ec0b5e30 legacy=0x7f90ec15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f1046700 1 -- 172.21.15.37:0/3211861665 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0ae3a0 con 0x7f90ec0b6200 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90eb7fe700 1 -- 172.21.15.37:0/3211861665 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987916530 0 0) 0x7f90ec0ae9f0 con 0x7f90ec0b5e30 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f1046700 1 --2- 172.21.15.37:0/3211861665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b6200 0x7f90ec0ad800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009e60 tx=0x7f90e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca0d61f74125f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90eb7fe700 1 -- 172.21.15.37:0/3211861665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e400e070 con 0x7f90ec0b6200 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90eb7fe700 1 -- 172.21.15.37:0/3211861665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400bbf0 con 0x7f90ec0b6200 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90eb7fe700 1 -- 172.21.15.37:0/3211861665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4012430 con 0x7f90ec0b6200 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3211861665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b6200 msgr2=0x7f90ec0ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.224+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3211861665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b6200 0x7f90ec0ad800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009e60 tx=0x7f90e4009780 comp rx=0 tx=0).stop 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.225+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3211861665 shutdown_connections 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.225+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3211861665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b6200 0x7f90ec0ad800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.225+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3211861665 >> 172.21.15.37:0/3211861665 conn(0x7f90ec099a10 msgr2=0x7f90ec06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.225+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3211861665 shutdown_connections 2023-10-06T04:17:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.225+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3211861665 wait complete. 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.226+0000 7f90f2aa9700 1 Processor -- start 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.226+0000 7f90f2aa9700 1 -- start start 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90ec0b6200 0x7f90ec1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90ec15dc70 0x7f90ec153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec16cf00 con 0x7f90ec0b5e30 2023-10-06T04:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec151e20 con 0x7f90ec15dc70 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec152100 con 0x7f90ec0b6200 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54276/0 (socket says 172.21.15.37:54276) 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 -- 172.21.15.37:0/3687208459 learned_addr learned my addr 172.21.15.37:0/3687208459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f1046700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90ec15dc70 0x7f90ec153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90ebfff700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90ec0b6200 0x7f90ec1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 -- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90ec0b6200 msgr2=0x7f90ec1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90ec0b6200 0x7f90ec1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 -- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90ec15dc70 msgr2=0x7f90ec153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90ec15dc70 0x7f90ec153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 -- 172.21.15.37:0/3687208459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4009a20 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f0845700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c7e0 tx=0x7f90dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc005b30 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc005c90 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec1523e0 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc007300 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.227+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec1529a0 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.228+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec0b2f90 con 0x7f90ec0b5e30 2023-10-06T04:17:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.229+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90dc01b400 con 0x7f90ec0b5e30 2023-10-06T04:17:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.229+0000 7f90e8ff9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 0x7f90d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.229+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90dc0841a0 con 0x7f90ec0b5e30 2023-10-06T04:17:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.229+0000 7f90ebfff700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 0x7f90d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.230+0000 7f90ebfff700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 0x7f90d80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90ec09a0b0 tx=0x7f90e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.234+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90dc051330 con 0x7f90ec0b5e30 2023-10-06T04:17:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.426+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90ec063410 con 0x7f90ec0b5e30 2023-10-06T04:17:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.427+0000 7f90e8ff9700 1 -- 172.21.15.37:0/3687208459 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f90dc054950 con 0x7f90ec0b5e30 2023-10-06T04:17:00.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.428+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 msgr2=0x7f90d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 0x7f90d80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90ec09a0b0 tx=0x7f90e0008040 comp rx=0 tx=0).stop 2023-10-06T04:17:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 msgr2=0x7f90ec16c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c7e0 tx=0x7f90dc007df0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 shutdown_connections 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90d8066f30 0x7f90d80693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90ec15dc70 0x7f90ec153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ec0b5e30 0x7f90ec16c9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 --2- 172.21.15.37:0/3687208459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90ec0b6200 0x7f90ec1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 >> 172.21.15.37:0/3687208459 conn(0x7f90ec099a10 msgr2=0x7f90ec063930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 shutdown_connections 2023-10-06T04:17:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.429+0000 7f90f2aa9700 1 -- 172.21.15.37:0/3687208459 wait complete. 2023-10-06T04:17:00.443 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:17:00.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.561+0000 7f64fecbc700 1 Processor -- start 2023-10-06T04:17:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.561+0000 7f64fecbc700 1 -- start start 2023-10-06T04:17:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fecbc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64f80ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fecbc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f64f80b6200 0x7f64f80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fecbc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80ae9f0 con 0x7f64f80b5e30 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fecbc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80adb70 con 0x7f64f80b6200 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fecbc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80adde0 con 0x7f64f815dc70 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fca58700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f64f80b5e30 0x7f64f815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55108/0 (socket says 172.21.15.37:55108) 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fca58700 1 -- 172.21.15.37:0/922872953 learned_addr learned my addr 172.21.15.37:0/922872953 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887576418 0 0) 0x7f64f80ae9f0 con 0x7f64f80b5e30 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e0003570 con 0x7f64f80b5e30 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64fd259700 1 --2- 172.21.15.37:0/922872953 >> v2:172.21.15.83:3300/0 conn(0x7f64f80b6200 0x7f64f80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.562+0000 7f64f7fff700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64f80ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371183506 0 0) 0x7f64e0003570 con 0x7f64f80b5e30 2023-10-06T04:17:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 msgr2=0x7f64f80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64f80ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 >> v2:172.21.15.83:3300/0 conn(0x7f64f80b6200 msgr2=0x7f64f80ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 --2- 172.21.15.37:0/922872953 >> v2:172.21.15.83:3300/0 conn(0x7f64f80b6200 0x7f64f80ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80ae0c0 con 0x7f64f80b5e30 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f64e8001470 con 0x7f64f80b5e30 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 >> v1:172.21.15.37:6789/0 conn(0x7f64f80b5e30 legacy=0x7f64f815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e0003a60 0x7f64e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64e0004810 0x7f64e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80adb70 con 0x7f64e0004810 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80adde0 con 0x7f64e0003a60 2023-10-06T04:17:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e000bae0 con 0x7f64f815dc70 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64e0004810 0x7f64e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64fca58700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e0003a60 0x7f64e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64fd259700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 -- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 msgr2=0x7f64e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 -- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e0003a60 msgr2=0x7f64e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e0003a60 0x7f64e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 -- 172.21.15.37:0/922872953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0003570 con 0x7f64e0004810 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64fd259700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64f815dc70 0x7f64e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f7fff700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64e0004810 0x7f64e0004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009c00 tx=0x7f64ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b79cac883fd4d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00e710 con 0x7f64e0004810 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00e870 con 0x7f64e0004810 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.563+0000 7f64f77fe700 1 -- 172.21.15.37:0/922872953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00ec30 con 0x7f64e0004810 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 -- 172.21.15.37:0/922872953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64e0004810 msgr2=0x7f64e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 --2- 172.21.15.37:0/922872953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64e0004810 0x7f64e0004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009c00 tx=0x7f64ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fd259700 1 -- 172.21.15.37:0/922872953 reap_dead start 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 -- 172.21.15.37:0/922872953 shutdown_connections 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 -- 172.21.15.37:0/922872953 >> 172.21.15.37:0/922872953 conn(0x7f64f8099a10 msgr2=0x7f64f806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 -- 172.21.15.37:0/922872953 shutdown_connections 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.564+0000 7f64fecbc700 1 -- 172.21.15.37:0/922872953 wait complete. 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.565+0000 7f64fecbc700 1 Processor -- start 2023-10-06T04:17:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.565+0000 7f64fecbc700 1 -- start start 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64e0004810 0x7f64f809d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f816a490 0x7f64f816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f809ca90 con 0x7f64f809b4c0 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f809c1f0 con 0x7f64f816a490 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fecbc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f809c4d0 con 0x7f64e0004810 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54302/0 (socket says 172.21.15.37:54302) 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 -- 172.21.15.37:0/946167421 learned_addr learned my addr 172.21.15.37:0/946167421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fca58700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64e0004810 0x7f64f809d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64f7fff700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f816a490 0x7f64f816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 -- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64e0004810 msgr2=0x7f64f809d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64e0004810 0x7f64f809d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 -- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f816a490 msgr2=0x7f64f816a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f816a490 0x7f64f816a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.566+0000 7f64fd259700 1 -- 172.21.15.37:0/946167421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f809c7b0 con 0x7f64f809b4c0 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64fd259700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d1770 tx=0x7f64f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000fbd0 con 0x7f64f809b4c0 2023-10-06T04:17:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000fd50 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0016670 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f816b1b0 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.567+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f809be60 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.568+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f815d330 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.568+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64f0016a60 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.568+0000 7f64f4ff9700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.569+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64f00850f0 con 0x7f64f809b4c0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.569+0000 7f64fca58700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.569+0000 7f64fca58700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001620 tx=0x7f64e8001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.573+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64f0052200 con 0x7f64f809b4c0 2023-10-06T04:17:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.766+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64f80b2f90 con 0x7f64e4066f30 2023-10-06T04:17:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.775+0000 7f64f4ff9700 1 -- 172.21.15.37:0/946167421 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283864 (secure 0 0 0) 0x7f64f80b2f90 con 0x7f64e4066f30 2023-10-06T04:17:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 msgr2=0x7f64e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001620 tx=0x7f64e8001e90 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 msgr2=0x7f64f809b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d1770 tx=0x7f64f000b040 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 shutdown_connections 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f809b4c0 0x7f64f809b920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f64e0004810 0x7f64f809d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 --2- 172.21.15.37:0/946167421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64f816a490 0x7f64f816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 >> 172.21.15.37:0/946167421 conn(0x7f64f8099a10 msgr2=0x7f64f815cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 shutdown_connections 2023-10-06T04:17:00.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.778+0000 7f64fecbc700 1 -- 172.21.15.37:0/946167421 wait complete. 2023-10-06T04:17:00.783 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:00.791 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T04:16:59.483370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381148,"kb_used_data":2844,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593572,"statfs":{"total":773094113280,"available":770655817728,"internally_reserved":0,"allocated":2912256,"data_stored":1778624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.850341"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640599+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:55.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637957+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642335+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635398+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637255+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642315+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637071+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642764+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644698+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640426+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:51.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637656+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634682+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641819+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642168+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641403+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643348+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634718+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637127+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.646113+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634667+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639410+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638919+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638339+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648135+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:55.648135+0000","last_peered":"2023-10-06T04:16:55.648135+0000","last_clean":"2023-10-06T04:16:55.648135+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:55.648135+0000","last_undegraded":"2023-10-06T04:16:55.648135+0000","last_fullsized":"2023-10-06T04:16:55.648135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643634+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.639342+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:55.639342+0000","last_peered":"2023-10-06T04:16:55.639342+0000","last_clean":"2023-10-06T04:16:55.639342+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:55.639342+0000","last_undegraded":"2023-10-06T04:16:55.639342+0000","last_fullsized":"2023-10-06T04:16:55.639342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642239+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650734+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:55.650734+0000","last_peered":"2023-10-06T04:16:55.650734+0000","last_clean":"2023-10-06T04:16:55.650734+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:55.650734+0000","last_undegraded":"2023-10-06T04:16:55.650734+0000","last_fullsized":"2023-10-06T04:16:55.650734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641726+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654519+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:55.654519+0000","last_peered":"2023-10-06T04:16:55.654519+0000","last_clean":"2023-10-06T04:16:55.654519+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:55.654519+0000","last_undegraded":"2023-10-06T04:16:55.654519+0000","last_fullsized":"2023-10-06T04:16:55.654519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642304+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647827+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:55.647827+0000","last_peered":"2023-10-06T04:16:55.647827+0000","last_clean":"2023-10-06T04:16:55.647827+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:55.647827+0000","last_undegraded":"2023-10-06T04:16:55.647827+0000","last_fullsized":"2023-10-06T04:16:55.647827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640953+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649098+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:55.649098+0000","last_peered":"2023-10-06T04:16:55.649098+0000","last_clean":"2023-10-06T04:16:55.649098+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:55.649098+0000","last_undegraded":"2023-10-06T04:16:55.649098+0000","last_fullsized":"2023-10-06T04:16:55.649098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637761+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654573+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:55.654573+0000","last_peered":"2023-10-06T04:16:55.654573+0000","last_clean":"2023-10-06T04:16:55.654573+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:55.654573+0000","last_undegraded":"2023-10-06T04:16:55.654573+0000","last_fullsized":"2023-10-06T04:16:55.654573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643672+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655088+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:55.655088+0000","last_peered":"2023-10-06T04:16:55.655088+0000","last_clean":"2023-10-06T04:16:55.655088+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:55.655088+0000","last_undegraded":"2023-10-06T04:16:55.655088+0000","last_fullsized":"2023-10-06T04:16:55.655088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641001+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650429+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:55.650429+0000","last_peered":"2023-10-06T04:16:55.650429+0000","last_clean":"2023-10-06T04:16:55.650429+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:55.650429+0000","last_undegraded":"2023-10-06T04:16:55.650429+0000","last_fullsized":"2023-10-06T04:16:55.650429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636496+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655616+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:55.655616+0000","last_peered":"2023-10-06T04:16:55.655616+0000","last_clean":"2023-10-06T04:16:55.655616+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:55.655616+0000","last_undegraded":"2023-10-06T04:16:55.655616+0000","last_fullsized":"2023-10-06T04:16:55.655616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642912+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652432+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:55.652432+0000","last_peered":"2023-10-06T04:16:55.652432+0000","last_clean":"2023-10-06T04:16:55.652432+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:55.652432+0000","last_undegraded":"2023-10-06T04:16:55.652432+0000","last_fullsized":"2023-10-06T04:16:55.652432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641407+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649831+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:55.649831+0000","last_peered":"2023-10-06T04:16:55.649831+0000","last_clean":"2023-10-06T04:16:55.649831+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:55.649831+0000","last_undegraded":"2023-10-06T04:16:55.649831+0000","last_fullsized":"2023-10-06T04:16:55.649831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635852+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654834+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:55.654834+0000","last_peered":"2023-10-06T04:16:55.654834+0000","last_clean":"2023-10-06T04:16:55.654834+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:55.654834+0000","last_undegraded":"2023-10-06T04:16:55.654834+0000","last_fullsized":"2023-10-06T04:16:55.654834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644034+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646833+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:55.646833+0000","last_peered":"2023-10-06T04:16:55.646833+0000","last_clean":"2023-10-06T04:16:55.646833+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:55.646833+0000","last_undegraded":"2023-10-06T04:16:55.646833+0000","last_fullsized":"2023-10-06T04:16:55.646833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642582+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648678+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:55.648678+0000","last_peered":"2023-10-06T04:16:55.648678+0000","last_clean":"2023-10-06T04:16:55.648678+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:55.648678+0000","last_undegraded":"2023-10-06T04:16:55.648678+0000","last_fullsized":"2023-10-06T04:16:55.648678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643691+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652840+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:55.652840+0000","last_peered":"2023-10-06T04:16:55.652840+0000","last_clean":"2023-10-06T04:16:55.652840+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:55.652840+0000","last_undegraded":"2023-10-06T04:16:55.652840+0000","last_fullsized":"2023-10-06T04:16:55.652840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641261+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654980+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:55.654980+0000","last_peered":"2023-10-06T04:16:55.654980+0000","last_clean":"2023-10-06T04:16:55.654980+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:55.654980+0000","last_undegraded":"2023-10-06T04:16:55.654980+0000","last_fullsized":"2023-10-06T04:16:55.654980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639120+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647489+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:55.647489+0000","last_peered":"2023-10-06T04:16:55.647489+0000","last_clean":"2023-10-06T04:16:55.647489+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:55.647489+0000","last_undegraded":"2023-10-06T04:16:55.647489+0000","last_fullsized":"2023-10-06T04:16:55.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648749+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:55.648749+0000","last_peered":"2023-10-06T04:16:55.648749+0000","last_clean":"2023-10-06T04:16:55.648749+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:55.648749+0000","last_undegraded":"2023-10-06T04:16:55.648749+0000","last_fullsized":"2023-10-06T04:16:55.648749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638144+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631913+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:54.631913+0000","last_peered":"2023-10-06T04:16:54.631913+0000","last_clean":"2023-10-06T04:16:54.631913+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:54.631913+0000","last_undegraded":"2023-10-06T04:16:54.631913+0000","last_fullsized":"2023-10-06T04:16:54.631913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648680+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:55.648680+0000","last_peered":"2023-10-06T04:16:55.648680+0000","last_clean":"2023-10-06T04:16:55.648680+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:55.648680+0000","last_undegraded":"2023-10-06T04:16:55.648680+0000","last_fullsized":"2023-10-06T04:16:55.648680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636211+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641840+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:54.641840+0000","last_peered":"2023-10-06T04:16:54.641840+0000","last_clean":"2023-10-06T04:16:54.641840+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:54.641840+0000","last_undegraded":"2023-10-06T04:16:54.641840+0000","last_fullsized":"2023-10-06T04:16:54.641840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.653618+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:55.653618+0000","last_peered":"2023-10-06T04:16:55.653618+0000","last_clean":"2023-10-06T04:16:55.653618+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:55.653618+0000","last_undegraded":"2023-10-06T04:16:55.653618+0000","last_fullsized":"2023-10-06T04:16:55.653618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636918+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.635072+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:54.635072+0000","last_peered":"2023-10-06T04:16:54.635072+0000","last_clean":"2023-10-06T04:16:54.635072+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:54.635072+0000","last_undegraded":"2023-10-06T04:16:54.635072+0000","last_fullsized":"2023-10-06T04:16:54.635072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646128+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:55.646128+0000","last_peered":"2023-10-06T04:16:55.646128+0000","last_clean":"2023-10-06T04:16:55.646128+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:55.646128+0000","last_undegraded":"2023-10-06T04:16:55.646128+0000","last_fullsized":"2023-10-06T04:16:55.646128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637077+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641621+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:54.641621+0000","last_peered":"2023-10-06T04:16:54.641621+0000","last_clean":"2023-10-06T04:16:54.641621+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:54.641621+0000","last_undegraded":"2023-10-06T04:16:54.641621+0000","last_fullsized":"2023-10-06T04:16:54.641621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639475+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:54.639475+0000","last_peered":"2023-10-06T04:16:54.639475+0000","last_clean":"2023-10-06T04:16:54.639475+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:54.639475+0000","last_undegraded":"2023-10-06T04:16:54.639475+0000","last_fullsized":"2023-10-06T04:16:54.639475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.645182+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:55.645182+0000","last_peered":"2023-10-06T04:16:55.645182+0000","last_clean":"2023-10-06T04:16:55.645182+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:55.645182+0000","last_undegraded":"2023-10-06T04:16:55.645182+0000","last_fullsized":"2023-10-06T04:16:55.645182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641440+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639426+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:54.639426+0000","last_peered":"2023-10-06T04:16:54.639426+0000","last_clean":"2023-10-06T04:16:54.639426+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:54.639426+0000","last_undegraded":"2023-10-06T04:16:54.639426+0000","last_fullsized":"2023-10-06T04:16:54.639426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646360+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:55.646360+0000","last_peered":"2023-10-06T04:16:55.646360+0000","last_clean":"2023-10-06T04:16:55.646360+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:55.646360+0000","last_undegraded":"2023-10-06T04:16:55.646360+0000","last_fullsized":"2023-10-06T04:16:55.646360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641577+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641025+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:54.641025+0000","last_peered":"2023-10-06T04:16:54.641025+0000","last_clean":"2023-10-06T04:16:54.641025+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:54.641025+0000","last_undegraded":"2023-10-06T04:16:54.641025+0000","last_fullsized":"2023-10-06T04:16:54.641025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649571+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:55.649571+0000","last_peered":"2023-10-06T04:16:55.649571+0000","last_clean":"2023-10-06T04:16:55.649571+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:55.649571+0000","last_undegraded":"2023-10-06T04:16:55.649571+0000","last_fullsized":"2023-10-06T04:16:55.649571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636632+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651045+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:55.651045+0000","last_peered":"2023-10-06T04:16:55.651045+0000","last_clean":"2023-10-06T04:16:55.651045+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:55.651045+0000","last_undegraded":"2023-10-06T04:16:55.651045+0000","last_fullsized":"2023-10-06T04:16:55.651045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631956+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:54.631956+0000","last_peered":"2023-10-06T04:16:54.631956+0000","last_clean":"2023-10-06T04:16:54.631956+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:54.631956+0000","last_undegraded":"2023-10-06T04:16:54.631956+0000","last_fullsized":"2023-10-06T04:16:54.631956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641818+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.640355+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:54.640355+0000","last_peered":"2023-10-06T04:16:54.640355+0000","last_clean":"2023-10-06T04:16:54.640355+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:54.640355+0000","last_undegraded":"2023-10-06T04:16:54.640355+0000","last_fullsized":"2023-10-06T04:16:54.640355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651462+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:55.651462+0000","last_peered":"2023-10-06T04:16:55.651462+0000","last_clean":"2023-10-06T04:16:55.651462+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:55.651462+0000","last_undegraded":"2023-10-06T04:16:55.651462+0000","last_fullsized":"2023-10-06T04:16:55.651462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641429+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654822+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:55.654822+0000","last_peered":"2023-10-06T04:16:55.654822+0000","last_clean":"2023-10-06T04:16:55.654822+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:55.654822+0000","last_undegraded":"2023-10-06T04:16:55.654822+0000","last_fullsized":"2023-10-06T04:16:55.654822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640984+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648120+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:55.648120+0000","last_peered":"2023-10-06T04:16:55.648120+0000","last_clean":"2023-10-06T04:16:55.648120+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:55.648120+0000","last_undegraded":"2023-10-06T04:16:55.648120+0000","last_fullsized":"2023-10-06T04:16:55.648120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640712+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649819+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:55.649819+0000","last_peered":"2023-10-06T04:16:55.649819+0000","last_clean":"2023-10-06T04:16:55.649819+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:55.649819+0000","last_undegraded":"2023-10-06T04:16:55.649819+0000","last_fullsized":"2023-10-06T04:16:55.649819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638939+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648999+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:55.648999+0000","last_peered":"2023-10-06T04:16:55.648999+0000","last_clean":"2023-10-06T04:16:55.648999+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:55.648999+0000","last_undegraded":"2023-10-06T04:16:55.648999+0000","last_fullsized":"2023-10-06T04:16:55.648999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654612+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:55.654612+0000","last_peered":"2023-10-06T04:16:55.654612+0000","last_clean":"2023-10-06T04:16:55.654612+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:55.654612+0000","last_undegraded":"2023-10-06T04:16:55.654612+0000","last_fullsized":"2023-10-06T04:16:55.654612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641700+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641342+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.645627+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640507+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643392+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638884+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":659322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:00.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.950+0000 7f93cd911700 1 Processor -- start 2023-10-06T04:17:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.950+0000 7f93cd911700 1 -- start start 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93cd911700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93cd911700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93c8067ba0 0x7f93c80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93cd911700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c8067fe0 con 0x7f93c8159480 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93cd911700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c806e7e0 con 0x7f93c8067ba0 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93cd911700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c806eac0 con 0x7f93c8159850 2023-10-06T04:17:00.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c6ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93c8159480 0x7f93c80c92d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55124/0 (socket says 172.21.15.37:55124) 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c6ffd700 1 -- 172.21.15.37:0/903770123 learned_addr learned my addr 172.21.15.37:0/903770123 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c77fe700 1 --2- 172.21.15.37:0/903770123 >> v2:172.21.15.37:3300/0 conn(0x7f93c8067ba0 0x7f93c80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c67fc700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c5ffb700 1 -- 172.21.15.37:0/903770123 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281137127 0 0) 0x7f93c8067fe0 con 0x7f93c8159480 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c5ffb700 1 -- 172.21.15.37:0/903770123 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b4003570 con 0x7f93c8159480 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c77fe700 1 -- 172.21.15.37:0/903770123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 msgr2=0x7f93c8067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c77fe700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c77fe700 1 -- 172.21.15.37:0/903770123 >> v1:172.21.15.37:6789/0 conn(0x7f93c8159480 legacy=0x7f93c80c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.951+0000 7f93c77fe700 1 -- 172.21.15.37:0/903770123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c806eda0 con 0x7f93c8067ba0 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93c77fe700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80c7a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93b80098e0 tx=0x7f93b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c55c9c5570d24c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93c5ffb700 1 -- 172.21.15.37:0/903770123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8011630 con 0x7f93c8067ba0 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93c5ffb700 1 -- 172.21.15.37:0/903770123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b8011790 con 0x7f93c8067ba0 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93c5ffb700 1 -- 172.21.15.37:0/903770123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8011b30 con 0x7f93c8067ba0 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 -- 172.21.15.37:0/903770123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 msgr2=0x7f93c80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80c7a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93b80098e0 tx=0x7f93b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 -- 172.21.15.37:0/903770123 shutdown_connections 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80c7a80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 --2- 172.21.15.37:0/903770123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 -- 172.21.15.37:0/903770123 >> 172.21.15.37:0/903770123 conn(0x7f93c80cddd0 msgr2=0x7f93c80c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 -- 172.21.15.37:0/903770123 shutdown_connections 2023-10-06T04:17:00.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.952+0000 7f93cd911700 1 -- 172.21.15.37:0/903770123 wait complete. 2023-10-06T04:17:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 Processor -- start 2023-10-06T04:17:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 -- start start 2023-10-06T04:17:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 0x7f93c81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8169b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80ac770 con 0x7f93c8067ba0 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80aa090 con 0x7f93c8159480 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93cd911700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80ac140 con 0x7f93c8159850 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.954+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54314/0 (socket says 172.21.15.37:54314) 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 -- 172.21.15.37:0/384854659 learned_addr learned my addr 172.21.15.37:0/384854659 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c67fc700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 0x7f93c81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c77fe700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8169b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 -- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 msgr2=0x7f93c8169b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8169b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 -- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 msgr2=0x7f93c81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 0x7f93c81585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 -- 172.21.15.37:0/384854659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8009420 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c67fc700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 0x7f93c81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93c6ffd700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93c000cd30 tx=0x7f93c0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000ab70 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000acf0 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c80a9db0 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0007340 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.955+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c80b07d0 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.956+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c806e420 con 0x7f93c8067ba0 2023-10-06T04:17:00.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.956+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93c0007770 con 0x7f93c8067ba0 2023-10-06T04:17:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.957+0000 7f93beffd700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.957+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f93c0084b70 con 0x7f93c8067ba0 2023-10-06T04:17:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.957+0000 7f93c67fc700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.957+0000 7f93c67fc700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 0x7f93a80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b3100 tx=0x7f93b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:00.961+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93c0051d00 con 0x7f93c8067ba0 2023-10-06T04:17:01.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.151+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93c80abfc0 con 0x7f93a8066f30 2023-10-06T04:17:01.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.159+0000 7f93beffd700 1 -- 172.21.15.37:0/384854659 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283864 (secure 0 0 0) 0x7f93b0009aa0 con 0x7f93a8066f30 2023-10-06T04:17:01.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 msgr2=0x7f93a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 0x7f93a80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b3100 tx=0x7f93b0008040 comp rx=0 tx=0).stop 2023-10-06T04:17:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 msgr2=0x7f93c80b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93c000cd30 tx=0x7f93c0001b10 comp rx=0 tx=0).stop 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 shutdown_connections 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93c8159850 0x7f93c8169b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93c8067ba0 0x7f93c80b0290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f93a8066f30 0x7f93a80693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 --2- 172.21.15.37:0/384854659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93c8159480 0x7f93c81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 >> 172.21.15.37:0/384854659 conn(0x7f93c80cddd0 msgr2=0x7f93c814e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.162+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 shutdown_connections 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.163+0000 7f93cd911700 1 -- 172.21.15.37:0/384854659 wait complete. 2023-10-06T04:17:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:01.176 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T04:16:59.483370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381148,"kb_used_data":2844,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593572,"statfs":{"total":773094113280,"available":770655817728,"internally_reserved":0,"allocated":2912256,"data_stored":1778624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.850341"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640599+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:55.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637957+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642335+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635398+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637255+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642315+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637071+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642764+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644698+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640426+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:51.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637656+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634682+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641819+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642168+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641403+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643348+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634718+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637127+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.646113+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634667+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639410+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638919+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638339+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648135+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:55.648135+0000","last_peered":"2023-10-06T04:16:55.648135+0000","last_clean":"2023-10-06T04:16:55.648135+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:55.648135+0000","last_undegraded":"2023-10-06T04:16:55.648135+0000","last_fullsized":"2023-10-06T04:16:55.648135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643634+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.639342+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:55.639342+0000","last_peered":"2023-10-06T04:16:55.639342+0000","last_clean":"2023-10-06T04:16:55.639342+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:55.639342+0000","last_undegraded":"2023-10-06T04:16:55.639342+0000","last_fullsized":"2023-10-06T04:16:55.639342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642239+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650734+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:55.650734+0000","last_peered":"2023-10-06T04:16:55.650734+0000","last_clean":"2023-10-06T04:16:55.650734+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:55.650734+0000","last_undegraded":"2023-10-06T04:16:55.650734+0000","last_fullsized":"2023-10-06T04:16:55.650734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641726+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654519+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:55.654519+0000","last_peered":"2023-10-06T04:16:55.654519+0000","last_clean":"2023-10-06T04:16:55.654519+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:55.654519+0000","last_undegraded":"2023-10-06T04:16:55.654519+0000","last_fullsized":"2023-10-06T04:16:55.654519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642304+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647827+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:55.647827+0000","last_peered":"2023-10-06T04:16:55.647827+0000","last_clean":"2023-10-06T04:16:55.647827+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:55.647827+0000","last_undegraded":"2023-10-06T04:16:55.647827+0000","last_fullsized":"2023-10-06T04:16:55.647827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640953+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649098+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:55.649098+0000","last_peered":"2023-10-06T04:16:55.649098+0000","last_clean":"2023-10-06T04:16:55.649098+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:55.649098+0000","last_undegraded":"2023-10-06T04:16:55.649098+0000","last_fullsized":"2023-10-06T04:16:55.649098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637761+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654573+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:55.654573+0000","last_peered":"2023-10-06T04:16:55.654573+0000","last_clean":"2023-10-06T04:16:55.654573+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:55.654573+0000","last_undegraded":"2023-10-06T04:16:55.654573+0000","last_fullsized":"2023-10-06T04:16:55.654573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643672+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655088+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:55.655088+0000","last_peered":"2023-10-06T04:16:55.655088+0000","last_clean":"2023-10-06T04:16:55.655088+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:55.655088+0000","last_undegraded":"2023-10-06T04:16:55.655088+0000","last_fullsized":"2023-10-06T04:16:55.655088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641001+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650429+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:55.650429+0000","last_peered":"2023-10-06T04:16:55.650429+0000","last_clean":"2023-10-06T04:16:55.650429+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:55.650429+0000","last_undegraded":"2023-10-06T04:16:55.650429+0000","last_fullsized":"2023-10-06T04:16:55.650429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636496+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655616+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:55.655616+0000","last_peered":"2023-10-06T04:16:55.655616+0000","last_clean":"2023-10-06T04:16:55.655616+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:55.655616+0000","last_undegraded":"2023-10-06T04:16:55.655616+0000","last_fullsized":"2023-10-06T04:16:55.655616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642912+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652432+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:55.652432+0000","last_peered":"2023-10-06T04:16:55.652432+0000","last_clean":"2023-10-06T04:16:55.652432+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:55.652432+0000","last_undegraded":"2023-10-06T04:16:55.652432+0000","last_fullsized":"2023-10-06T04:16:55.652432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641407+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649831+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:55.649831+0000","last_peered":"2023-10-06T04:16:55.649831+0000","last_clean":"2023-10-06T04:16:55.649831+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:55.649831+0000","last_undegraded":"2023-10-06T04:16:55.649831+0000","last_fullsized":"2023-10-06T04:16:55.649831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635852+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654834+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:55.654834+0000","last_peered":"2023-10-06T04:16:55.654834+0000","last_clean":"2023-10-06T04:16:55.654834+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:55.654834+0000","last_undegraded":"2023-10-06T04:16:55.654834+0000","last_fullsized":"2023-10-06T04:16:55.654834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644034+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646833+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:55.646833+0000","last_peered":"2023-10-06T04:16:55.646833+0000","last_clean":"2023-10-06T04:16:55.646833+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:55.646833+0000","last_undegraded":"2023-10-06T04:16:55.646833+0000","last_fullsized":"2023-10-06T04:16:55.646833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642582+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648678+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:55.648678+0000","last_peered":"2023-10-06T04:16:55.648678+0000","last_clean":"2023-10-06T04:16:55.648678+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:55.648678+0000","last_undegraded":"2023-10-06T04:16:55.648678+0000","last_fullsized":"2023-10-06T04:16:55.648678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643691+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652840+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:55.652840+0000","last_peered":"2023-10-06T04:16:55.652840+0000","last_clean":"2023-10-06T04:16:55.652840+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:55.652840+0000","last_undegraded":"2023-10-06T04:16:55.652840+0000","last_fullsized":"2023-10-06T04:16:55.652840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641261+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654980+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:55.654980+0000","last_peered":"2023-10-06T04:16:55.654980+0000","last_clean":"2023-10-06T04:16:55.654980+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:55.654980+0000","last_undegraded":"2023-10-06T04:16:55.654980+0000","last_fullsized":"2023-10-06T04:16:55.654980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639120+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647489+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:55.647489+0000","last_peered":"2023-10-06T04:16:55.647489+0000","last_clean":"2023-10-06T04:16:55.647489+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:55.647489+0000","last_undegraded":"2023-10-06T04:16:55.647489+0000","last_fullsized":"2023-10-06T04:16:55.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648749+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:55.648749+0000","last_peered":"2023-10-06T04:16:55.648749+0000","last_clean":"2023-10-06T04:16:55.648749+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:55.648749+0000","last_undegraded":"2023-10-06T04:16:55.648749+0000","last_fullsized":"2023-10-06T04:16:55.648749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638144+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631913+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:54.631913+0000","last_peered":"2023-10-06T04:16:54.631913+0000","last_clean":"2023-10-06T04:16:54.631913+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:54.631913+0000","last_undegraded":"2023-10-06T04:16:54.631913+0000","last_fullsized":"2023-10-06T04:16:54.631913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648680+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:55.648680+0000","last_peered":"2023-10-06T04:16:55.648680+0000","last_clean":"2023-10-06T04:16:55.648680+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:55.648680+0000","last_undegraded":"2023-10-06T04:16:55.648680+0000","last_fullsized":"2023-10-06T04:16:55.648680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636211+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641840+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:54.641840+0000","last_peered":"2023-10-06T04:16:54.641840+0000","last_clean":"2023-10-06T04:16:54.641840+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:54.641840+0000","last_undegraded":"2023-10-06T04:16:54.641840+0000","last_fullsized":"2023-10-06T04:16:54.641840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.653618+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:55.653618+0000","last_peered":"2023-10-06T04:16:55.653618+0000","last_clean":"2023-10-06T04:16:55.653618+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:55.653618+0000","last_undegraded":"2023-10-06T04:16:55.653618+0000","last_fullsized":"2023-10-06T04:16:55.653618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636918+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.635072+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:54.635072+0000","last_peered":"2023-10-06T04:16:54.635072+0000","last_clean":"2023-10-06T04:16:54.635072+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:54.635072+0000","last_undegraded":"2023-10-06T04:16:54.635072+0000","last_fullsized":"2023-10-06T04:16:54.635072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646128+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:55.646128+0000","last_peered":"2023-10-06T04:16:55.646128+0000","last_clean":"2023-10-06T04:16:55.646128+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:55.646128+0000","last_undegraded":"2023-10-06T04:16:55.646128+0000","last_fullsized":"2023-10-06T04:16:55.646128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637077+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641621+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:54.641621+0000","last_peered":"2023-10-06T04:16:54.641621+0000","last_clean":"2023-10-06T04:16:54.641621+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:54.641621+0000","last_undegraded":"2023-10-06T04:16:54.641621+0000","last_fullsized":"2023-10-06T04:16:54.641621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639475+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:54.639475+0000","last_peered":"2023-10-06T04:16:54.639475+0000","last_clean":"2023-10-06T04:16:54.639475+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:54.639475+0000","last_undegraded":"2023-10-06T04:16:54.639475+0000","last_fullsized":"2023-10-06T04:16:54.639475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.645182+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:55.645182+0000","last_peered":"2023-10-06T04:16:55.645182+0000","last_clean":"2023-10-06T04:16:55.645182+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:55.645182+0000","last_undegraded":"2023-10-06T04:16:55.645182+0000","last_fullsized":"2023-10-06T04:16:55.645182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641440+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639426+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:54.639426+0000","last_peered":"2023-10-06T04:16:54.639426+0000","last_clean":"2023-10-06T04:16:54.639426+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:54.639426+0000","last_undegraded":"2023-10-06T04:16:54.639426+0000","last_fullsized":"2023-10-06T04:16:54.639426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646360+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:55.646360+0000","last_peered":"2023-10-06T04:16:55.646360+0000","last_clean":"2023-10-06T04:16:55.646360+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:55.646360+0000","last_undegraded":"2023-10-06T04:16:55.646360+0000","last_fullsized":"2023-10-06T04:16:55.646360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641577+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641025+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:54.641025+0000","last_peered":"2023-10-06T04:16:54.641025+0000","last_clean":"2023-10-06T04:16:54.641025+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:54.641025+0000","last_undegraded":"2023-10-06T04:16:54.641025+0000","last_fullsized":"2023-10-06T04:16:54.641025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649571+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:55.649571+0000","last_peered":"2023-10-06T04:16:55.649571+0000","last_clean":"2023-10-06T04:16:55.649571+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:55.649571+0000","last_undegraded":"2023-10-06T04:16:55.649571+0000","last_fullsized":"2023-10-06T04:16:55.649571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636632+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651045+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:55.651045+0000","last_peered":"2023-10-06T04:16:55.651045+0000","last_clean":"2023-10-06T04:16:55.651045+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:55.651045+0000","last_undegraded":"2023-10-06T04:16:55.651045+0000","last_fullsized":"2023-10-06T04:16:55.651045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631956+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:54.631956+0000","last_peered":"2023-10-06T04:16:54.631956+0000","last_clean":"2023-10-06T04:16:54.631956+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:54.631956+0000","last_undegraded":"2023-10-06T04:16:54.631956+0000","last_fullsized":"2023-10-06T04:16:54.631956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641818+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.640355+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:54.640355+0000","last_peered":"2023-10-06T04:16:54.640355+0000","last_clean":"2023-10-06T04:16:54.640355+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:54.640355+0000","last_undegraded":"2023-10-06T04:16:54.640355+0000","last_fullsized":"2023-10-06T04:16:54.640355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651462+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:55.651462+0000","last_peered":"2023-10-06T04:16:55.651462+0000","last_clean":"2023-10-06T04:16:55.651462+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:55.651462+0000","last_undegraded":"2023-10-06T04:16:55.651462+0000","last_fullsized":"2023-10-06T04:16:55.651462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641429+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654822+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:55.654822+0000","last_peered":"2023-10-06T04:16:55.654822+0000","last_clean":"2023-10-06T04:16:55.654822+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:55.654822+0000","last_undegraded":"2023-10-06T04:16:55.654822+0000","last_fullsized":"2023-10-06T04:16:55.654822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640984+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648120+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:55.648120+0000","last_peered":"2023-10-06T04:16:55.648120+0000","last_clean":"2023-10-06T04:16:55.648120+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:55.648120+0000","last_undegraded":"2023-10-06T04:16:55.648120+0000","last_fullsized":"2023-10-06T04:16:55.648120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640712+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649819+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:55.649819+0000","last_peered":"2023-10-06T04:16:55.649819+0000","last_clean":"2023-10-06T04:16:55.649819+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:55.649819+0000","last_undegraded":"2023-10-06T04:16:55.649819+0000","last_fullsized":"2023-10-06T04:16:55.649819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638939+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648999+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:55.648999+0000","last_peered":"2023-10-06T04:16:55.648999+0000","last_clean":"2023-10-06T04:16:55.648999+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:55.648999+0000","last_undegraded":"2023-10-06T04:16:55.648999+0000","last_fullsized":"2023-10-06T04:16:55.648999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654612+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:55.654612+0000","last_peered":"2023-10-06T04:16:55.654612+0000","last_clean":"2023-10-06T04:16:55.654612+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:55.654612+0000","last_undegraded":"2023-10-06T04:16:55.654612+0000","last_fullsized":"2023-10-06T04:16:55.654612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641700+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641342+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.645627+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640507+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643392+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638884+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":659322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:01.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.334+0000 7fc428a24700 1 Processor -- start 2023-10-06T04:17:01.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.334+0000 7fc428a24700 1 -- start start 2023-10-06T04:17:01.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc428a24700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4240b6200 0x7fc4240ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc428a24700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4240ae9f0 con 0x7fc42415dc70 2023-10-06T04:17:01.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc428a24700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4240adde0 con 0x7fc4240b5e30 2023-10-06T04:17:01.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc428a24700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4240ae0c0 con 0x7fc4240b6200 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc422d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4240b6200 0x7fc4240ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc421d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc42415dc70 0x7fc4240ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55140/0 (socket says 172.21.15.37:55140) 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc421d9b700 1 -- 172.21.15.37:0/302445466 learned_addr learned my addr 172.21.15.37:0/302445466 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc422d9d700 1 -- 172.21.15.37:0/302445466 >> v1:172.21.15.83:6789/0 conn(0x7fc4240b5e30 legacy=0x7fc42415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc422d9d700 1 -- 172.21.15.37:0/302445466 >> v1:172.21.15.37:6789/0 conn(0x7fc42415dc70 legacy=0x7fc4240ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc422d9d700 1 -- 172.21.15.37:0/302445466 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4240ae3a0 con 0x7fc4240b6200 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc42159a700 1 -- 172.21.15.37:0/302445466 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567727630 0 0) 0x7fc4240ae9f0 con 0x7fc42415dc70 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.335+0000 7fc422d9d700 1 --2- 172.21.15.37:0/302445466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4240b6200 0x7fc4240ad800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009e60 tx=0x7fc41c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37135b37d346c1fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc42159a700 1 -- 172.21.15.37:0/302445466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00e070 con 0x7fc4240b6200 2023-10-06T04:17:01.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc42159a700 1 -- 172.21.15.37:0/302445466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c00bc30 con 0x7fc4240b6200 2023-10-06T04:17:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc42159a700 1 -- 172.21.15.37:0/302445466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c012430 con 0x7fc4240b6200 2023-10-06T04:17:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 -- 172.21.15.37:0/302445466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4240b6200 msgr2=0x7fc4240ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 --2- 172.21.15.37:0/302445466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4240b6200 0x7fc4240ad800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009e60 tx=0x7fc41c009780 comp rx=0 tx=0).stop 2023-10-06T04:17:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 -- 172.21.15.37:0/302445466 shutdown_connections 2023-10-06T04:17:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 --2- 172.21.15.37:0/302445466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4240b6200 0x7fc4240ad800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 -- 172.21.15.37:0/302445466 >> 172.21.15.37:0/302445466 conn(0x7fc424099a10 msgr2=0x7fc42406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 -- 172.21.15.37:0/302445466 shutdown_connections 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.336+0000 7fc428a24700 1 -- 172.21.15.37:0/302445466 wait complete. 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.337+0000 7fc428a24700 1 Processor -- start 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.337+0000 7fc428a24700 1 -- start start 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4240b5e30 0x7fc4241564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 0x7fc4240c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4240c62f0 con 0x7fc42415dc70 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42409cbc0 con 0x7fc4240b5e30 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc428a24700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42409cea0 con 0x7fc4240b6200 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54342/0 (socket says 172.21.15.37:54342) 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 -- 172.21.15.37:0/3821859867 learned_addr learned my addr 172.21.15.37:0/3821859867 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc421d9b700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 0x7fc4240c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc42259c700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4240b5e30 0x7fc4241564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 -- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 msgr2=0x7fc4240c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 0x7fc4240c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 -- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4240b5e30 msgr2=0x7fc4241564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4240b5e30 0x7fc4241564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc422d9d700 1 -- 172.21.15.37:0/3821859867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c009a20 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.338+0000 7fc421d9b700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 0x7fc4240c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc422d9d700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41c013000 tx=0x7fc41c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c012e80 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c01d630 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42409d180 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c01d9b0 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.339+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42409d740 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.340+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4240b2f90 con 0x7fc42415dc70 2023-10-06T04:17:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.340+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc41c024070 con 0x7fc42415dc70 2023-10-06T04:17:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.340+0000 7fc4127fc700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.341+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc41c086e70 con 0x7fc42415dc70 2023-10-06T04:17:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.341+0000 7fc42259c700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.341+0000 7fc42259c700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 0x7fc4040693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc414003aa0 tx=0x7fc414000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.345+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc41c054030 con 0x7fc42415dc70 2023-10-06T04:17:01.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.533+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4240ae680 con 0x7fc404066f30 2023-10-06T04:17:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.541+0000 7fc4127fc700 1 -- 172.21.15.37:0/3821859867 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283864 (secure 0 0 0) 0x7fc4240ae680 con 0x7fc404066f30 2023-10-06T04:17:01.546 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:01.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 msgr2=0x7fc4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 0x7fc4040693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc414003aa0 tx=0x7fc414000bc0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 msgr2=0x7fc42414b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc41c013000 tx=0x7fc41c019000 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 shutdown_connections 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42415dc70 0x7fc42414b230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4240b5e30 0x7fc4241564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 --2- 172.21.15.37:0/3821859867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc4240b6200 0x7fc4240c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 >> 172.21.15.37:0/3821859867 conn(0x7fc424099a10 msgr2=0x7fc424156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 shutdown_connections 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.545+0000 7fc428a24700 1 -- 172.21.15.37:0/3821859867 wait complete. 2023-10-06T04:17:01.549 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:01.558 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T04:17:01.483802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381148,"kb_used_data":2844,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593572,"statfs":{"total":773094113280,"available":770655817728,"internally_reserved":0,"allocated":2912256,"data_stored":1778624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001305"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640599+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:55.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637957+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642335+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635398+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637255+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642315+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637071+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642764+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644698+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640426+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:51.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637656+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634682+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641819+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642168+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641403+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643348+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634718+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637127+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.646113+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634667+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639410+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638919+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638339+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648135+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:55.648135+0000","last_peered":"2023-10-06T04:16:55.648135+0000","last_clean":"2023-10-06T04:16:55.648135+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:55.648135+0000","last_undegraded":"2023-10-06T04:16:55.648135+0000","last_fullsized":"2023-10-06T04:16:55.648135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643634+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.639342+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:55.639342+0000","last_peered":"2023-10-06T04:16:55.639342+0000","last_clean":"2023-10-06T04:16:55.639342+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:55.639342+0000","last_undegraded":"2023-10-06T04:16:55.639342+0000","last_fullsized":"2023-10-06T04:16:55.639342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642239+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650734+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:55.650734+0000","last_peered":"2023-10-06T04:16:55.650734+0000","last_clean":"2023-10-06T04:16:55.650734+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:55.650734+0000","last_undegraded":"2023-10-06T04:16:55.650734+0000","last_fullsized":"2023-10-06T04:16:55.650734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641726+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654519+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:55.654519+0000","last_peered":"2023-10-06T04:16:55.654519+0000","last_clean":"2023-10-06T04:16:55.654519+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:55.654519+0000","last_undegraded":"2023-10-06T04:16:55.654519+0000","last_fullsized":"2023-10-06T04:16:55.654519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642304+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647827+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:55.647827+0000","last_peered":"2023-10-06T04:16:55.647827+0000","last_clean":"2023-10-06T04:16:55.647827+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:55.647827+0000","last_undegraded":"2023-10-06T04:16:55.647827+0000","last_fullsized":"2023-10-06T04:16:55.647827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640953+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649098+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:55.649098+0000","last_peered":"2023-10-06T04:16:55.649098+0000","last_clean":"2023-10-06T04:16:55.649098+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:55.649098+0000","last_undegraded":"2023-10-06T04:16:55.649098+0000","last_fullsized":"2023-10-06T04:16:55.649098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637761+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654573+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:55.654573+0000","last_peered":"2023-10-06T04:16:55.654573+0000","last_clean":"2023-10-06T04:16:55.654573+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:55.654573+0000","last_undegraded":"2023-10-06T04:16:55.654573+0000","last_fullsized":"2023-10-06T04:16:55.654573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643672+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655088+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:55.655088+0000","last_peered":"2023-10-06T04:16:55.655088+0000","last_clean":"2023-10-06T04:16:55.655088+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:55.655088+0000","last_undegraded":"2023-10-06T04:16:55.655088+0000","last_fullsized":"2023-10-06T04:16:55.655088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641001+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650429+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:55.650429+0000","last_peered":"2023-10-06T04:16:55.650429+0000","last_clean":"2023-10-06T04:16:55.650429+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:55.650429+0000","last_undegraded":"2023-10-06T04:16:55.650429+0000","last_fullsized":"2023-10-06T04:16:55.650429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636496+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655616+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:55.655616+0000","last_peered":"2023-10-06T04:16:55.655616+0000","last_clean":"2023-10-06T04:16:55.655616+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:55.655616+0000","last_undegraded":"2023-10-06T04:16:55.655616+0000","last_fullsized":"2023-10-06T04:16:55.655616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642912+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652432+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:55.652432+0000","last_peered":"2023-10-06T04:16:55.652432+0000","last_clean":"2023-10-06T04:16:55.652432+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:55.652432+0000","last_undegraded":"2023-10-06T04:16:55.652432+0000","last_fullsized":"2023-10-06T04:16:55.652432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641407+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649831+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:55.649831+0000","last_peered":"2023-10-06T04:16:55.649831+0000","last_clean":"2023-10-06T04:16:55.649831+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:55.649831+0000","last_undegraded":"2023-10-06T04:16:55.649831+0000","last_fullsized":"2023-10-06T04:16:55.649831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635852+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654834+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:55.654834+0000","last_peered":"2023-10-06T04:16:55.654834+0000","last_clean":"2023-10-06T04:16:55.654834+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:55.654834+0000","last_undegraded":"2023-10-06T04:16:55.654834+0000","last_fullsized":"2023-10-06T04:16:55.654834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644034+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646833+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:55.646833+0000","last_peered":"2023-10-06T04:16:55.646833+0000","last_clean":"2023-10-06T04:16:55.646833+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:55.646833+0000","last_undegraded":"2023-10-06T04:16:55.646833+0000","last_fullsized":"2023-10-06T04:16:55.646833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642582+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648678+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:55.648678+0000","last_peered":"2023-10-06T04:16:55.648678+0000","last_clean":"2023-10-06T04:16:55.648678+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:55.648678+0000","last_undegraded":"2023-10-06T04:16:55.648678+0000","last_fullsized":"2023-10-06T04:16:55.648678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643691+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652840+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:55.652840+0000","last_peered":"2023-10-06T04:16:55.652840+0000","last_clean":"2023-10-06T04:16:55.652840+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:55.652840+0000","last_undegraded":"2023-10-06T04:16:55.652840+0000","last_fullsized":"2023-10-06T04:16:55.652840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641261+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654980+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:55.654980+0000","last_peered":"2023-10-06T04:16:55.654980+0000","last_clean":"2023-10-06T04:16:55.654980+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:55.654980+0000","last_undegraded":"2023-10-06T04:16:55.654980+0000","last_fullsized":"2023-10-06T04:16:55.654980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639120+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647489+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:55.647489+0000","last_peered":"2023-10-06T04:16:55.647489+0000","last_clean":"2023-10-06T04:16:55.647489+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:55.647489+0000","last_undegraded":"2023-10-06T04:16:55.647489+0000","last_fullsized":"2023-10-06T04:16:55.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648749+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:55.648749+0000","last_peered":"2023-10-06T04:16:55.648749+0000","last_clean":"2023-10-06T04:16:55.648749+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:55.648749+0000","last_undegraded":"2023-10-06T04:16:55.648749+0000","last_fullsized":"2023-10-06T04:16:55.648749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638144+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631913+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:54.631913+0000","last_peered":"2023-10-06T04:16:54.631913+0000","last_clean":"2023-10-06T04:16:54.631913+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:54.631913+0000","last_undegraded":"2023-10-06T04:16:54.631913+0000","last_fullsized":"2023-10-06T04:16:54.631913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648680+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:55.648680+0000","last_peered":"2023-10-06T04:16:55.648680+0000","last_clean":"2023-10-06T04:16:55.648680+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:55.648680+0000","last_undegraded":"2023-10-06T04:16:55.648680+0000","last_fullsized":"2023-10-06T04:16:55.648680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636211+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641840+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:54.641840+0000","last_peered":"2023-10-06T04:16:54.641840+0000","last_clean":"2023-10-06T04:16:54.641840+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:54.641840+0000","last_undegraded":"2023-10-06T04:16:54.641840+0000","last_fullsized":"2023-10-06T04:16:54.641840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.653618+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:55.653618+0000","last_peered":"2023-10-06T04:16:55.653618+0000","last_clean":"2023-10-06T04:16:55.653618+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:55.653618+0000","last_undegraded":"2023-10-06T04:16:55.653618+0000","last_fullsized":"2023-10-06T04:16:55.653618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636918+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.635072+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:54.635072+0000","last_peered":"2023-10-06T04:16:54.635072+0000","last_clean":"2023-10-06T04:16:54.635072+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:54.635072+0000","last_undegraded":"2023-10-06T04:16:54.635072+0000","last_fullsized":"2023-10-06T04:16:54.635072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646128+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:55.646128+0000","last_peered":"2023-10-06T04:16:55.646128+0000","last_clean":"2023-10-06T04:16:55.646128+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:55.646128+0000","last_undegraded":"2023-10-06T04:16:55.646128+0000","last_fullsized":"2023-10-06T04:16:55.646128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637077+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641621+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:54.641621+0000","last_peered":"2023-10-06T04:16:54.641621+0000","last_clean":"2023-10-06T04:16:54.641621+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:54.641621+0000","last_undegraded":"2023-10-06T04:16:54.641621+0000","last_fullsized":"2023-10-06T04:16:54.641621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639475+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:54.639475+0000","last_peered":"2023-10-06T04:16:54.639475+0000","last_clean":"2023-10-06T04:16:54.639475+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:54.639475+0000","last_undegraded":"2023-10-06T04:16:54.639475+0000","last_fullsized":"2023-10-06T04:16:54.639475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.645182+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:55.645182+0000","last_peered":"2023-10-06T04:16:55.645182+0000","last_clean":"2023-10-06T04:16:55.645182+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:55.645182+0000","last_undegraded":"2023-10-06T04:16:55.645182+0000","last_fullsized":"2023-10-06T04:16:55.645182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641440+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639426+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:54.639426+0000","last_peered":"2023-10-06T04:16:54.639426+0000","last_clean":"2023-10-06T04:16:54.639426+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:54.639426+0000","last_undegraded":"2023-10-06T04:16:54.639426+0000","last_fullsized":"2023-10-06T04:16:54.639426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646360+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:55.646360+0000","last_peered":"2023-10-06T04:16:55.646360+0000","last_clean":"2023-10-06T04:16:55.646360+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:55.646360+0000","last_undegraded":"2023-10-06T04:16:55.646360+0000","last_fullsized":"2023-10-06T04:16:55.646360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641577+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641025+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:54.641025+0000","last_peered":"2023-10-06T04:16:54.641025+0000","last_clean":"2023-10-06T04:16:54.641025+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:54.641025+0000","last_undegraded":"2023-10-06T04:16:54.641025+0000","last_fullsized":"2023-10-06T04:16:54.641025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649571+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:55.649571+0000","last_peered":"2023-10-06T04:16:55.649571+0000","last_clean":"2023-10-06T04:16:55.649571+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:55.649571+0000","last_undegraded":"2023-10-06T04:16:55.649571+0000","last_fullsized":"2023-10-06T04:16:55.649571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636632+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651045+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:55.651045+0000","last_peered":"2023-10-06T04:16:55.651045+0000","last_clean":"2023-10-06T04:16:55.651045+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:55.651045+0000","last_undegraded":"2023-10-06T04:16:55.651045+0000","last_fullsized":"2023-10-06T04:16:55.651045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631956+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:54.631956+0000","last_peered":"2023-10-06T04:16:54.631956+0000","last_clean":"2023-10-06T04:16:54.631956+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:54.631956+0000","last_undegraded":"2023-10-06T04:16:54.631956+0000","last_fullsized":"2023-10-06T04:16:54.631956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641818+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.640355+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:54.640355+0000","last_peered":"2023-10-06T04:16:54.640355+0000","last_clean":"2023-10-06T04:16:54.640355+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:54.640355+0000","last_undegraded":"2023-10-06T04:16:54.640355+0000","last_fullsized":"2023-10-06T04:16:54.640355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651462+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:55.651462+0000","last_peered":"2023-10-06T04:16:55.651462+0000","last_clean":"2023-10-06T04:16:55.651462+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:55.651462+0000","last_undegraded":"2023-10-06T04:16:55.651462+0000","last_fullsized":"2023-10-06T04:16:55.651462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641429+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654822+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:55.654822+0000","last_peered":"2023-10-06T04:16:55.654822+0000","last_clean":"2023-10-06T04:16:55.654822+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:55.654822+0000","last_undegraded":"2023-10-06T04:16:55.654822+0000","last_fullsized":"2023-10-06T04:16:55.654822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640984+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648120+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:55.648120+0000","last_peered":"2023-10-06T04:16:55.648120+0000","last_clean":"2023-10-06T04:16:55.648120+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:55.648120+0000","last_undegraded":"2023-10-06T04:16:55.648120+0000","last_fullsized":"2023-10-06T04:16:55.648120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640712+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649819+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:55.649819+0000","last_peered":"2023-10-06T04:16:55.649819+0000","last_clean":"2023-10-06T04:16:55.649819+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:55.649819+0000","last_undegraded":"2023-10-06T04:16:55.649819+0000","last_fullsized":"2023-10-06T04:16:55.649819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638939+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648999+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:55.648999+0000","last_peered":"2023-10-06T04:16:55.648999+0000","last_clean":"2023-10-06T04:16:55.648999+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:55.648999+0000","last_undegraded":"2023-10-06T04:16:55.648999+0000","last_fullsized":"2023-10-06T04:16:55.648999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654612+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:55.654612+0000","last_peered":"2023-10-06T04:16:55.654612+0000","last_clean":"2023-10-06T04:16:55.654612+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:55.654612+0000","last_undegraded":"2023-10-06T04:16:55.654612+0000","last_fullsized":"2023-10-06T04:16:55.654612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641700+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641342+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.645627+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640507+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643392+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638884+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":659322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:01.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-10-06T04:17:01.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640599+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:59:55.347286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:17:01.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637957+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643825+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642160+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642335+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.644825+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.635398+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637255+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642315+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-10-06T04:17:01.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637071+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642764+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.644698+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640426+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:10:51.114400+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637656+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.634682+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.639160+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641819+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-10-06T04:17:01.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642168+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641403+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643348+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.634718+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637127+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.646113+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.634667+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.639410+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.638919+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-06T04:17:01.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.638339+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643634+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642239+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641726+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-06T04:17:01.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642304+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640953+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637761+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643672+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-06T04:17:01.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641001+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.636496+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642912+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641407+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.635852+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-06T04:17:01.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.644034+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.642582+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643691+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641261+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-06T04:17:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.639120+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640468+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.638144+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.636211+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-06T04:17:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.636918+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.637077+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641440+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641577+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-06T04:17:01.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.636632+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641818+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641429+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640984+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640712+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-06T04:17:01.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.638939+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643468+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641700+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.641342+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-10-06T04:17:01.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.645627+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.640507+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.643392+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-10-06T04:17:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T04:16:55.629650+0000', 'last_change': '2023-10-06T04:16:55.638884+0000', 'last_active': '2023-10-06T04:16:55.629650+0000', 'last_peered': '2023-10-06T04:16:55.629650+0000', 'last_clean': '2023-10-06T04:16:55.629650+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T04:16:55.629650+0000', 'last_undegraded': '2023-10-06T04:16:55.629650+0000', 'last_fullsized': '2023-10-06T04:16:55.629650+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'last_clean_scrub_stamp': '2023-10-06T04:16:55.629650+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T04:17:01.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T04:17:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.715+0000 7f1d7f177700 1 Processor -- start 2023-10-06T04:17:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.715+0000 7f1d7f177700 1 -- start start 2023-10-06T04:17:01.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d7f177700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d780b2310 0x7f1d781576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d7f177700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780cb080 con 0x7f1d7806edf0 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d7f177700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780cad50 con 0x7f1d78157320 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d7f177700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d78068780 con 0x7f1d780b2310 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d7d714700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d780b2310 0x7f1d781576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d77fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d7806edf0 0x7f1d780b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55150/0 (socket says 172.21.15.37:55150) 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.716+0000 7f1d77fff700 1 -- 172.21.15.37:0/3911091916 learned_addr learned my addr 172.21.15.37:0/3911091916 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7d714700 1 -- 172.21.15.37:0/3911091916 >> v1:172.21.15.83:6789/0 conn(0x7f1d78157320 legacy=0x7f1d78068070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7d714700 1 -- 172.21.15.37:0/3911091916 >> v1:172.21.15.37:6789/0 conn(0x7f1d7806edf0 legacy=0x7f1d780b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d777fe700 1 -- 172.21.15.37:0/3911091916 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306447588 0 0) 0x7f1d780cb080 con 0x7f1d7806edf0 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7d714700 1 -- 172.21.15.37:0/3911091916 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78068970 con 0x7f1d780b2310 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7d714700 1 --2- 172.21.15.37:0/3911091916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d780b2310 0x7f1d781576f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e60 tx=0x7f1d70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd78654720a450d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d777fe700 1 -- 172.21.15.37:0/3911091916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000e070 con 0x7f1d780b2310 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d777fe700 1 -- 172.21.15.37:0/3911091916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000bc30 con 0x7f1d780b2310 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d777fe700 1 -- 172.21.15.37:0/3911091916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70012430 con 0x7f1d780b2310 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7f177700 1 -- 172.21.15.37:0/3911091916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d780b2310 msgr2=0x7f1d781576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.717+0000 7f1d7f177700 1 --2- 172.21.15.37:0/3911091916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d780b2310 0x7f1d781576f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e60 tx=0x7f1d70009780 comp rx=0 tx=0).stop 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.718+0000 7f1d7f177700 1 -- 172.21.15.37:0/3911091916 shutdown_connections 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.718+0000 7f1d7f177700 1 --2- 172.21.15.37:0/3911091916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d780b2310 0x7f1d781576f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.718+0000 7f1d7f177700 1 -- 172.21.15.37:0/3911091916 >> 172.21.15.37:0/3911091916 conn(0x7f1d7806b8e0 msgr2=0x7f1d7806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.718+0000 7f1d7f177700 1 -- 172.21.15.37:0/3911091916 shutdown_connections 2023-10-06T04:17:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.718+0000 7f1d7f177700 1 -- 172.21.15.37:0/3911091916 wait complete. 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.719+0000 7f1d7f177700 1 Processor -- start 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.719+0000 7f1d7f177700 1 -- start start 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.719+0000 7f1d7f177700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.719+0000 7f1d7f177700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 0x7f1d780c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 0x7f1d780ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780abd40 con 0x7f1d7806edf0 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780abf70 con 0x7f1d78157320 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780ac250 con 0x7f1d780b2310 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54360/0 (socket says 172.21.15.37:54360) 2023-10-06T04:17:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 -- 172.21.15.37:0/121878000 learned_addr learned my addr 172.21.15.37:0/121878000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d77fff700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 0x7f1d780c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7d714700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 0x7f1d780ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 -- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 msgr2=0x7f1d780c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 0x7f1d780c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 -- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 msgr2=0x7f1d780ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 0x7f1d780ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 -- 172.21.15.37:0/121878000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009a20 con 0x7f1d7806edf0 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d77fff700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 0x7f1d780c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7d714700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 0x7f1d780ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7cf13700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c4e0 tx=0x7f1d6800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68011590 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68011710 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780afa90 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68011ad0 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.720+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d780b0050 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.721+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d78063410 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.722+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d6801b3b0 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.722+0000 7f1d74ff9700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 0x7f1d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.722+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d68083bd0 con 0x7f1d7806edf0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.722+0000 7f1d77fff700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 0x7f1d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.723+0000 7f1d77fff700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 0x7f1d640693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d780ab730 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:01.726+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d68050ce0 con 0x7f1d7806edf0 2023-10-06T04:17:01.728 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-10-06T04:17:01.728+0000 7f9a1978a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:17:02.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.000+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1d78068c50 con 0x7f1d7806edf0 2023-10-06T04:17:02.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.000+0000 7f1d74ff9700 1 -- 172.21.15.37:0/121878000 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1035 (secure 0 0 0) 0x7f1d68017020 con 0x7f1d7806edf0 2023-10-06T04:17:02.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:02.002 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":32,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1696565801,"num_in_osds":8,"osd_in_since":1696565792,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2438295552,"bytes_avail":770655817728,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4306}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-06T04:16:29.902358+0000","services":{}},"progress_events":{}} 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 msgr2=0x7f1d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 0x7f1d640693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d780ab730 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 msgr2=0x7f1d780b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800c4e0 tx=0x7f1d6800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 shutdown_connections 2023-10-06T04:17:02.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d64066f30 0x7f1d640693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d78157320 0x7f1d780ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d7806edf0 0x7f1d780b0570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 --2- 172.21.15.37:0/121878000 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d780b2310 0x7f1d780c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 >> 172.21.15.37:0/121878000 conn(0x7f1d7806b8e0 msgr2=0x7f1d78156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:02.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 shutdown_connections 2023-10-06T04:17:02.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.002+0000 7f1d7f177700 1 -- 172.21.15.37:0/121878000 wait complete. 2023-10-06T04:17:02.016 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T04:17:02.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:02.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 Processor -- start 2023-10-06T04:17:02.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 -- start start 2023-10-06T04:17:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15dc70 0x7f520c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c0b6200 0x7f520c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0ae9f0 con 0x7f520c0b5e30 2023-10-06T04:17:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0adb70 con 0x7f520c15dc70 2023-10-06T04:17:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.132+0000 7f52121b6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0adde0 con 0x7f520c0b6200 2023-10-06T04:17:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15dc70 0x7f520c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15dc70 0x7f520c0ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54368/0 (socket says 172.21.15.37:54368) 2023-10-06T04:17:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 -- 172.21.15.37:0/3348613193 learned_addr learned my addr 172.21.15.37:0/3348613193 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520bfff700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c0b6200 0x7f520c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 -- 172.21.15.37:0/3348613193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c0b6200 msgr2=0x7f520c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c0b6200 0x7f520c0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 -- 172.21.15.37:0/3348613193 >> v1:172.21.15.83:6789/0 conn(0x7f520c0b5e30 legacy=0x7f520c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 -- 172.21.15.37:0/3348613193 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0ae0c0 con 0x7f520c15dc70 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520affd700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15dc70 0x7f520c0ad0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51f40099b0 tx=0x7f51f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c645c28b041154 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520a7fc700 1 -- 172.21.15.37:0/3348613193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400b860 con 0x7f520c15dc70 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520a7fc700 1 -- 172.21.15.37:0/3348613193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f400b9c0 con 0x7f520c15dc70 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.133+0000 7f520a7fc700 1 -- 172.21.15.37:0/3348613193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400bd80 con 0x7f520c15dc70 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 -- 172.21.15.37:0/3348613193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15dc70 msgr2=0x7f520c0ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15dc70 0x7f520c0ad0f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51f40099b0 tx=0x7f51f4009250 comp rx=0 tx=0).stop 2023-10-06T04:17:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 -- 172.21.15.37:0/3348613193 shutdown_connections 2023-10-06T04:17:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c0b6200 0x7f520c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 --2- 172.21.15.37:0/3348613193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15dc70 0x7f520c0ad0f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 -- 172.21.15.37:0/3348613193 >> 172.21.15.37:0/3348613193 conn(0x7f520c099a10 msgr2=0x7f520c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 -- 172.21.15.37:0/3348613193 shutdown_connections 2023-10-06T04:17:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.134+0000 7f52121b6700 1 -- 172.21.15.37:0/3348613193 wait complete. 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.135+0000 7f52121b6700 1 Processor -- start 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.135+0000 7f52121b6700 1 -- start start 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f520c0b6200 0x7f520c140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c15dc70 0x7f520c09d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09c570 con 0x7f520c0b5e30 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09c850 con 0x7f520c0b6200 2023-10-06T04:17:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09cb30 con 0x7f520c15dc70 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54382/0 (socket says 172.21.15.37:54382) 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 -- 172.21.15.37:0/674453176 learned_addr learned my addr 172.21.15.37:0/674453176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520affd700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f520c0b6200 0x7f520c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520bfff700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c15dc70 0x7f520c09d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 -- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c15dc70 msgr2=0x7f520c09d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c15dc70 0x7f520c09d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 -- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f520c0b6200 msgr2=0x7f520c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f520c0b6200 0x7f520c140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 -- 172.21.15.37:0/674453176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40094f0 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f520b7fe700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c590 tx=0x7f51fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc011590 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0116f0 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c09ce10 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.136+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc011ab0 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.137+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c16e1b0 con 0x7f520c0b5e30 2023-10-06T04:17:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.137+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c16e3d0 con 0x7f520c0b5e30 2023-10-06T04:17:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.138+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51fc01b3b0 con 0x7f520c0b5e30 2023-10-06T04:17:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.138+0000 7f52037fe700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 0x7f51ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.138+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51fc083c40 con 0x7f520c0b5e30 2023-10-06T04:17:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.138+0000 7f520affd700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 0x7f51ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.139+0000 7f520affd700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 0x7f51ec0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51f40099b0 tx=0x7f51f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:02.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.142+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51fc050d50 con 0x7f520c0b5e30 2023-10-06T04:17:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.332+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f520c15d2d0 con 0x7f51ec066f30 2023-10-06T04:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.341+0000 7f52037fe700 1 -- 172.21.15.37:0/674453176 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283864 (secure 0 0 0) 0x7f520c15d2d0 con 0x7f51ec066f30 2023-10-06T04:17:02.346 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 msgr2=0x7f51ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 0x7f51ec0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51f40099b0 tx=0x7f51f4017000 comp rx=0 tx=0).stop 2023-10-06T04:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 msgr2=0x7f520c16dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c590 tx=0x7f51fc00c950 comp rx=0 tx=0).stop 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 shutdown_connections 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f520c15dc70 0x7f520c09d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0b5e30 0x7f520c16dc70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51ec066f30 0x7f51ec0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 --2- 172.21.15.37:0/674453176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f520c0b6200 0x7f520c140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.343+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 >> 172.21.15.37:0/674453176 conn(0x7f520c099a10 msgr2=0x7f520c069170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.344+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 shutdown_connections 2023-10-06T04:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:02.344+0000 7f52121b6700 1 -- 172.21.15.37:0/674453176 wait complete. 2023-10-06T04:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:02.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T04:17:01.483802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381148,"kb_used_data":2844,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593572,"statfs":{"total":773094113280,"available":770655817728,"internally_reserved":0,"allocated":2912256,"data_stored":1778624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001305"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640599+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:55.347286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637957+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642335+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644825+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635398+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637255+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642315+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637071+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642764+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644698+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640426+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:51.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637656+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634682+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639160+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641819+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642168+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641403+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643348+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634718+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637127+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.646113+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.634667+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639410+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638919+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638339+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648135+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:55.648135+0000","last_peered":"2023-10-06T04:16:55.648135+0000","last_clean":"2023-10-06T04:16:55.648135+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:55.648135+0000","last_undegraded":"2023-10-06T04:16:55.648135+0000","last_fullsized":"2023-10-06T04:16:55.648135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643634+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.639342+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:55.639342+0000","last_peered":"2023-10-06T04:16:55.639342+0000","last_clean":"2023-10-06T04:16:55.639342+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:55.639342+0000","last_undegraded":"2023-10-06T04:16:55.639342+0000","last_fullsized":"2023-10-06T04:16:55.639342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642239+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650734+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:55.650734+0000","last_peered":"2023-10-06T04:16:55.650734+0000","last_clean":"2023-10-06T04:16:55.650734+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:55.650734+0000","last_undegraded":"2023-10-06T04:16:55.650734+0000","last_fullsized":"2023-10-06T04:16:55.650734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641726+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654519+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:55.654519+0000","last_peered":"2023-10-06T04:16:55.654519+0000","last_clean":"2023-10-06T04:16:55.654519+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:55.654519+0000","last_undegraded":"2023-10-06T04:16:55.654519+0000","last_fullsized":"2023-10-06T04:16:55.654519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642304+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647827+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:55.647827+0000","last_peered":"2023-10-06T04:16:55.647827+0000","last_clean":"2023-10-06T04:16:55.647827+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:55.647827+0000","last_undegraded":"2023-10-06T04:16:55.647827+0000","last_fullsized":"2023-10-06T04:16:55.647827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640953+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649098+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:55.649098+0000","last_peered":"2023-10-06T04:16:55.649098+0000","last_clean":"2023-10-06T04:16:55.649098+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:55.649098+0000","last_undegraded":"2023-10-06T04:16:55.649098+0000","last_fullsized":"2023-10-06T04:16:55.649098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637761+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654573+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:55.654573+0000","last_peered":"2023-10-06T04:16:55.654573+0000","last_clean":"2023-10-06T04:16:55.654573+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:55.654573+0000","last_undegraded":"2023-10-06T04:16:55.654573+0000","last_fullsized":"2023-10-06T04:16:55.654573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643672+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655088+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:55.655088+0000","last_peered":"2023-10-06T04:16:55.655088+0000","last_clean":"2023-10-06T04:16:55.655088+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:55.655088+0000","last_undegraded":"2023-10-06T04:16:55.655088+0000","last_fullsized":"2023-10-06T04:16:55.655088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641001+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.650429+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:55.650429+0000","last_peered":"2023-10-06T04:16:55.650429+0000","last_clean":"2023-10-06T04:16:55.650429+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:55.650429+0000","last_undegraded":"2023-10-06T04:16:55.650429+0000","last_fullsized":"2023-10-06T04:16:55.650429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636496+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.655616+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:55.655616+0000","last_peered":"2023-10-06T04:16:55.655616+0000","last_clean":"2023-10-06T04:16:55.655616+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:55.655616+0000","last_undegraded":"2023-10-06T04:16:55.655616+0000","last_fullsized":"2023-10-06T04:16:55.655616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642912+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652432+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:55.652432+0000","last_peered":"2023-10-06T04:16:55.652432+0000","last_clean":"2023-10-06T04:16:55.652432+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:55.652432+0000","last_undegraded":"2023-10-06T04:16:55.652432+0000","last_fullsized":"2023-10-06T04:16:55.652432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641407+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649831+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:55.649831+0000","last_peered":"2023-10-06T04:16:55.649831+0000","last_clean":"2023-10-06T04:16:55.649831+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:55.649831+0000","last_undegraded":"2023-10-06T04:16:55.649831+0000","last_fullsized":"2023-10-06T04:16:55.649831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.635852+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654834+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:55.654834+0000","last_peered":"2023-10-06T04:16:55.654834+0000","last_clean":"2023-10-06T04:16:55.654834+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:55.654834+0000","last_undegraded":"2023-10-06T04:16:55.654834+0000","last_fullsized":"2023-10-06T04:16:55.654834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.644034+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646833+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:55.646833+0000","last_peered":"2023-10-06T04:16:55.646833+0000","last_clean":"2023-10-06T04:16:55.646833+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:55.646833+0000","last_undegraded":"2023-10-06T04:16:55.646833+0000","last_fullsized":"2023-10-06T04:16:55.646833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.642582+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648678+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:55.648678+0000","last_peered":"2023-10-06T04:16:55.648678+0000","last_clean":"2023-10-06T04:16:55.648678+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:55.648678+0000","last_undegraded":"2023-10-06T04:16:55.648678+0000","last_fullsized":"2023-10-06T04:16:55.648678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643691+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.652840+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:55.652840+0000","last_peered":"2023-10-06T04:16:55.652840+0000","last_clean":"2023-10-06T04:16:55.652840+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:55.652840+0000","last_undegraded":"2023-10-06T04:16:55.652840+0000","last_fullsized":"2023-10-06T04:16:55.652840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641261+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654980+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:55.654980+0000","last_peered":"2023-10-06T04:16:55.654980+0000","last_clean":"2023-10-06T04:16:55.654980+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:55.654980+0000","last_undegraded":"2023-10-06T04:16:55.654980+0000","last_fullsized":"2023-10-06T04:16:55.654980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.639120+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.647489+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:55.647489+0000","last_peered":"2023-10-06T04:16:55.647489+0000","last_clean":"2023-10-06T04:16:55.647489+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:55.647489+0000","last_undegraded":"2023-10-06T04:16:55.647489+0000","last_fullsized":"2023-10-06T04:16:55.647489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648749+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:55.648749+0000","last_peered":"2023-10-06T04:16:55.648749+0000","last_clean":"2023-10-06T04:16:55.648749+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:55.648749+0000","last_undegraded":"2023-10-06T04:16:55.648749+0000","last_fullsized":"2023-10-06T04:16:55.648749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638144+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:33.454424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631913+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:54.631913+0000","last_peered":"2023-10-06T04:16:54.631913+0000","last_clean":"2023-10-06T04:16:54.631913+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:54.631913+0000","last_undegraded":"2023-10-06T04:16:54.631913+0000","last_fullsized":"2023-10-06T04:16:54.631913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648680+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:55.648680+0000","last_peered":"2023-10-06T04:16:55.648680+0000","last_clean":"2023-10-06T04:16:55.648680+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:55.648680+0000","last_undegraded":"2023-10-06T04:16:55.648680+0000","last_fullsized":"2023-10-06T04:16:55.648680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636211+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641840+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:54.641840+0000","last_peered":"2023-10-06T04:16:54.641840+0000","last_clean":"2023-10-06T04:16:54.641840+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:54.641840+0000","last_undegraded":"2023-10-06T04:16:54.641840+0000","last_fullsized":"2023-10-06T04:16:54.641840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.653618+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:55.653618+0000","last_peered":"2023-10-06T04:16:55.653618+0000","last_clean":"2023-10-06T04:16:55.653618+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:55.653618+0000","last_undegraded":"2023-10-06T04:16:55.653618+0000","last_fullsized":"2023-10-06T04:16:55.653618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636918+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.635072+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:54.635072+0000","last_peered":"2023-10-06T04:16:54.635072+0000","last_clean":"2023-10-06T04:16:54.635072+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:54.635072+0000","last_undegraded":"2023-10-06T04:16:54.635072+0000","last_fullsized":"2023-10-06T04:16:54.635072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646128+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:55.646128+0000","last_peered":"2023-10-06T04:16:55.646128+0000","last_clean":"2023-10-06T04:16:55.646128+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:55.646128+0000","last_undegraded":"2023-10-06T04:16:55.646128+0000","last_fullsized":"2023-10-06T04:16:55.646128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.637077+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641621+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:54.641621+0000","last_peered":"2023-10-06T04:16:54.641621+0000","last_clean":"2023-10-06T04:16:54.641621+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:54.641621+0000","last_undegraded":"2023-10-06T04:16:54.641621+0000","last_fullsized":"2023-10-06T04:16:54.641621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639475+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:54.639475+0000","last_peered":"2023-10-06T04:16:54.639475+0000","last_clean":"2023-10-06T04:16:54.639475+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:54.639475+0000","last_undegraded":"2023-10-06T04:16:54.639475+0000","last_fullsized":"2023-10-06T04:16:54.639475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.645182+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:55.645182+0000","last_peered":"2023-10-06T04:16:55.645182+0000","last_clean":"2023-10-06T04:16:55.645182+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:55.645182+0000","last_undegraded":"2023-10-06T04:16:55.645182+0000","last_fullsized":"2023-10-06T04:16:55.645182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641440+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:45.923104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.639426+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:54.639426+0000","last_peered":"2023-10-06T04:16:54.639426+0000","last_clean":"2023-10-06T04:16:54.639426+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:54.639426+0000","last_undegraded":"2023-10-06T04:16:54.639426+0000","last_fullsized":"2023-10-06T04:16:54.639426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.646360+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:55.646360+0000","last_peered":"2023-10-06T04:16:55.646360+0000","last_clean":"2023-10-06T04:16:55.646360+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:55.646360+0000","last_undegraded":"2023-10-06T04:16:55.646360+0000","last_fullsized":"2023-10-06T04:16:55.646360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641577+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.641025+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:54.641025+0000","last_peered":"2023-10-06T04:16:54.641025+0000","last_clean":"2023-10-06T04:16:54.641025+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:54.641025+0000","last_undegraded":"2023-10-06T04:16:54.641025+0000","last_fullsized":"2023-10-06T04:16:54.641025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649571+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:55.649571+0000","last_peered":"2023-10-06T04:16:55.649571+0000","last_clean":"2023-10-06T04:16:55.649571+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:55.649571+0000","last_undegraded":"2023-10-06T04:16:55.649571+0000","last_fullsized":"2023-10-06T04:16:55.649571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.636632+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651045+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:55.651045+0000","last_peered":"2023-10-06T04:16:55.651045+0000","last_clean":"2023-10-06T04:16:55.651045+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:55.651045+0000","last_undegraded":"2023-10-06T04:16:55.651045+0000","last_fullsized":"2023-10-06T04:16:55.651045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.631956+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:54.631956+0000","last_peered":"2023-10-06T04:16:54.631956+0000","last_clean":"2023-10-06T04:16:54.631956+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:54.631956+0000","last_undegraded":"2023-10-06T04:16:54.631956+0000","last_fullsized":"2023-10-06T04:16:54.631956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641818+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:16:54.640355+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:54.640355+0000","last_peered":"2023-10-06T04:16:54.640355+0000","last_clean":"2023-10-06T04:16:54.640355+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:54.640355+0000","last_undegraded":"2023-10-06T04:16:54.640355+0000","last_fullsized":"2023-10-06T04:16:54.640355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.651462+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:55.651462+0000","last_peered":"2023-10-06T04:16:55.651462+0000","last_clean":"2023-10-06T04:16:55.651462+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:55.651462+0000","last_undegraded":"2023-10-06T04:16:55.651462+0000","last_fullsized":"2023-10-06T04:16:55.651462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641429+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:20.396381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654822+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:55.654822+0000","last_peered":"2023-10-06T04:16:55.654822+0000","last_clean":"2023-10-06T04:16:55.654822+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:55.654822+0000","last_undegraded":"2023-10-06T04:16:55.654822+0000","last_fullsized":"2023-10-06T04:16:55.654822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640984+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648120+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:55.648120+0000","last_peered":"2023-10-06T04:16:55.648120+0000","last_clean":"2023-10-06T04:16:55.648120+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:55.648120+0000","last_undegraded":"2023-10-06T04:16:55.648120+0000","last_fullsized":"2023-10-06T04:16:55.648120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640712+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.649819+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:55.649819+0000","last_peered":"2023-10-06T04:16:55.649819+0000","last_clean":"2023-10-06T04:16:55.649819+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:55.649819+0000","last_undegraded":"2023-10-06T04:16:55.649819+0000","last_fullsized":"2023-10-06T04:16:55.649819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638939+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.648999+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:55.648999+0000","last_peered":"2023-10-06T04:16:55.648999+0000","last_clean":"2023-10-06T04:16:55.648999+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:55.648999+0000","last_undegraded":"2023-10-06T04:16:55.648999+0000","last_fullsized":"2023-10-06T04:16:55.648999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643468+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.951928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:16:55.654612+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:55.654612+0000","last_peered":"2023-10-06T04:16:55.654612+0000","last_clean":"2023-10-06T04:16:55.654612+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:55.654612+0000","last_undegraded":"2023-10-06T04:16:55.654612+0000","last_fullsized":"2023-10-06T04:16:55.654612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641700+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.641342+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:37.243900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.645627+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.640507+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.643392+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T04:16:55.629650+0000","last_change":"2023-10-06T04:16:55.638884+0000","last_active":"2023-10-06T04:16:55.629650+0000","last_peered":"2023-10-06T04:16:55.629650+0000","last_clean":"2023-10-06T04:16:55.629650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:16:55.629650+0000","last_undegraded":"2023-10-06T04:16:55.629650+0000","last_fullsized":"2023-10-06T04:16:55.629650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:50.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":665930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":659322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:05.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.497+0000 7f84b05a4700 1 Processor -- start 2023-10-06T04:17:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.497+0000 7f84b05a4700 1 -- start start 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84b05a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84a80ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84b05a4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f84a80b6200 0x7f84a80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84b05a4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80ae9f0 con 0x7f84a80b5e30 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84b05a4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80adb70 con 0x7f84a80b6200 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84b05a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80adde0 con 0x7f84a815dc70 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ae340700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84a80b5e30 0x7f84a815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55164/0 (socket says 172.21.15.37:55164) 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ae340700 1 -- 172.21.15.37:0/3486686725 learned_addr learned my addr 172.21.15.37:0/3486686725 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84aeb41700 1 --2- 172.21.15.37:0/3486686725 >> v2:172.21.15.83:3300/0 conn(0x7f84a80b6200 0x7f84a80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84adb3f700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84a80ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353213683 0 0) 0x7f84a80ae9f0 con 0x7f84a80b5e30 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8490003570 con 0x7f84a80b5e30 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732704568 0 0) 0x7f8490003570 con 0x7f84a80b5e30 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 msgr2=0x7f84a80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84a80ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 >> v2:172.21.15.83:3300/0 conn(0x7f84a80b6200 msgr2=0x7f84a80ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 --2- 172.21.15.37:0/3486686725 >> v2:172.21.15.83:3300/0 conn(0x7f84a80b6200 0x7f84a80ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80ae0c0 con 0x7f84a80b5e30 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f84980017f0 con 0x7f84a80b5e30 2023-10-06T04:17:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 >> v1:172.21.15.37:6789/0 conn(0x7f84a80b5e30 legacy=0x7f84a815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8490003a60 0x7f8490003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f8490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80adb70 con 0x7f8490004810 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80adde0 con 0x7f8490003a60 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bae0 con 0x7f84a815dc70 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.498+0000 7f84aeb41700 1 --2- 172.21.15.37:0/3486686725 >> v2:172.21.15.83:3300/0 conn(0x7f84a80b6200 0x7f84a80ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f8490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84ae340700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8490003a60 0x7f8490003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84aeb41700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 -- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 msgr2=0x7f84900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a815dc70 0x7f84900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 -- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8490003a60 msgr2=0x7f8490003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8490003a60 0x7f8490003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 -- 172.21.15.37:0/3486686725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490003570 con 0x7f8490004810 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84adb3f700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f8490004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f849c009c00 tx=0x7f849c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20010eb2cad43b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00e710 con 0x7f8490004810 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c00e870 con 0x7f8490004810 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.499+0000 7f84ad33e700 1 -- 172.21.15.37:0/3486686725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00ec30 con 0x7f8490004810 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 -- 172.21.15.37:0/3486686725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 msgr2=0x7f8490004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 --2- 172.21.15.37:0/3486686725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f8490004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f849c009c00 tx=0x7f849c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84aeb41700 1 -- 172.21.15.37:0/3486686725 reap_dead start 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 -- 172.21.15.37:0/3486686725 shutdown_connections 2023-10-06T04:17:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 -- 172.21.15.37:0/3486686725 >> 172.21.15.37:0/3486686725 conn(0x7f84a8099a10 msgr2=0x7f84a806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:05.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 -- 172.21.15.37:0/3486686725 shutdown_connections 2023-10-06T04:17:05.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.500+0000 7f84b05a4700 1 -- 172.21.15.37:0/3486686725 wait complete. 2023-10-06T04:17:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.501+0000 7f84b05a4700 1 Processor -- start 2023-10-06T04:17:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.501+0000 7f84b05a4700 1 -- start start 2023-10-06T04:17:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a816bc90 0x7f84a80d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84a815b070 0x7f84a815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a815ba30 con 0x7f8490004810 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a816d4f0 con 0x7f84a815b070 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84b05a4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a816d060 con 0x7f84a816bc90 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54406/0 (socket says 172.21.15.37:54406) 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 -- 172.21.15.37:0/1986662185 learned_addr learned my addr 172.21.15.37:0/1986662185 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84adb3f700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a816bc90 0x7f84a80d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84aeb41700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84a815b070 0x7f84a815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 -- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a816bc90 msgr2=0x7f84a80d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a816bc90 0x7f84a80d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 -- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84a815b070 msgr2=0x7f84a815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84a815b070 0x7f84a815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 -- 172.21.15.37:0/1986662185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80d13d0 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84ae340700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8498007b20 tx=0x7f8498002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849800ad50 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.502+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84980133f0 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.503+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84980137b0 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.503+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a816c450 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.503+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a816ca10 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.503+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a816d340 con 0x7f8490004810 2023-10-06T04:17:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.504+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8498013ba0 con 0x7f8490004810 2023-10-06T04:17:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.504+0000 7f84a67fc700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.505+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84980851a0 con 0x7f8490004810 2023-10-06T04:17:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.505+0000 7f84adb3f700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.505+0000 7f84adb3f700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 0x7f84940693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f849c0091e0 tx=0x7f849c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.509+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84980522b0 con 0x7f8490004810 2023-10-06T04:17:05.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.698+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84a816d1a0 con 0x7f8494066f30 2023-10-06T04:17:05.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.707+0000 7f84a67fc700 1 -- 172.21.15.37:0/1986662185 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286697 (secure 0 0 0) 0x7f849c023040 con 0x7f8494066f30 2023-10-06T04:17:05.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 msgr2=0x7f84940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 0x7f84940693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f849c0091e0 tx=0x7f849c01a000 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 msgr2=0x7f84a816ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8498007b20 tx=0x7f8498002210 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 shutdown_connections 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8494066f30 0x7f84940693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84a815b070 0x7f84a815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490004810 0x7f84a816ace0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 --2- 172.21.15.37:0/1986662185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84a816bc90 0x7f84a80d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 >> 172.21.15.37:0/1986662185 conn(0x7f84a8099a10 msgr2=0x7f84a8158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 shutdown_connections 2023-10-06T04:17:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.710+0000 7f84b05a4700 1 -- 172.21.15.37:0/1986662185 wait complete. 2023-10-06T04:17:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:05.724 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-06T04:17:05.485099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":198,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381416,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593304,"statfs":{"total":773094113280,"available":770655543296,"internally_reserved":0,"allocated":3186688,"data_stored":1899900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.833866"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675807+0000","last_change":"2023-10-06T04:16:56.668658+0000","last_active":"2023-10-06T04:16:56.675807+0000","last_peered":"2023-10-06T04:16:56.675807+0000","last_clean":"2023-10-06T04:16:56.675807+0000","last_became_active":"2023-10-06T04:16:56.668367+0000","last_became_peered":"2023-10-06T04:16:56.668367+0000","last_unstale":"2023-10-06T04:16:56.675807+0000","last_undegraded":"2023-10-06T04:16:56.675807+0000","last_fullsized":"2023-10-06T04:16:56.675807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668025+0000","last_change":"2023-10-06T04:16:56.662736+0000","last_active":"2023-10-06T04:16:56.668025+0000","last_peered":"2023-10-06T04:16:56.668025+0000","last_clean":"2023-10-06T04:16:56.668025+0000","last_became_active":"2023-10-06T04:16:56.662469+0000","last_became_peered":"2023-10-06T04:16:56.662469+0000","last_unstale":"2023-10-06T04:16:56.668025+0000","last_undegraded":"2023-10-06T04:16:56.668025+0000","last_fullsized":"2023-10-06T04:16:56.668025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672509+0000","last_change":"2023-10-06T04:16:56.670653+0000","last_active":"2023-10-06T04:16:56.672509+0000","last_peered":"2023-10-06T04:16:56.672509+0000","last_clean":"2023-10-06T04:16:56.672509+0000","last_became_active":"2023-10-06T04:16:56.670416+0000","last_became_peered":"2023-10-06T04:16:56.670416+0000","last_unstale":"2023-10-06T04:16:56.672509+0000","last_undegraded":"2023-10-06T04:16:56.672509+0000","last_fullsized":"2023-10-06T04:16:56.672509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:11.137952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672609+0000","last_change":"2023-10-06T04:16:56.669774+0000","last_active":"2023-10-06T04:16:56.672609+0000","last_peered":"2023-10-06T04:16:56.672609+0000","last_clean":"2023-10-06T04:16:56.672609+0000","last_became_active":"2023-10-06T04:16:56.669493+0000","last_became_peered":"2023-10-06T04:16:56.669493+0000","last_unstale":"2023-10-06T04:16:56.672609+0000","last_undegraded":"2023-10-06T04:16:56.672609+0000","last_fullsized":"2023-10-06T04:16:56.672609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676488+0000","last_change":"2023-10-06T04:16:56.672513+0000","last_active":"2023-10-06T04:16:56.676488+0000","last_peered":"2023-10-06T04:16:56.676488+0000","last_clean":"2023-10-06T04:16:56.676488+0000","last_became_active":"2023-10-06T04:16:56.672282+0000","last_became_peered":"2023-10-06T04:16:56.672282+0000","last_unstale":"2023-10-06T04:16:56.676488+0000","last_undegraded":"2023-10-06T04:16:56.676488+0000","last_fullsized":"2023-10-06T04:16:56.676488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675009+0000","last_change":"2023-10-06T04:16:56.674519+0000","last_active":"2023-10-06T04:16:56.675009+0000","last_peered":"2023-10-06T04:16:56.675009+0000","last_clean":"2023-10-06T04:16:56.675009+0000","last_became_active":"2023-10-06T04:16:56.674243+0000","last_became_peered":"2023-10-06T04:16:56.674243+0000","last_unstale":"2023-10-06T04:16:56.675009+0000","last_undegraded":"2023-10-06T04:16:56.675009+0000","last_fullsized":"2023-10-06T04:16:56.675009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:52.285904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673077+0000","last_change":"2023-10-06T04:16:56.670881+0000","last_active":"2023-10-06T04:16:56.673077+0000","last_peered":"2023-10-06T04:16:56.673077+0000","last_clean":"2023-10-06T04:16:56.673077+0000","last_became_active":"2023-10-06T04:16:56.670084+0000","last_became_peered":"2023-10-06T04:16:56.670084+0000","last_unstale":"2023-10-06T04:16:56.673077+0000","last_undegraded":"2023-10-06T04:16:56.673077+0000","last_fullsized":"2023-10-06T04:16:56.673077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664646+0000","last_change":"2023-10-06T04:16:56.659682+0000","last_active":"2023-10-06T04:16:56.664646+0000","last_peered":"2023-10-06T04:16:56.664646+0000","last_clean":"2023-10-06T04:16:56.664646+0000","last_became_active":"2023-10-06T04:16:56.659343+0000","last_became_peered":"2023-10-06T04:16:56.659343+0000","last_unstale":"2023-10-06T04:16:56.664646+0000","last_undegraded":"2023-10-06T04:16:56.664646+0000","last_fullsized":"2023-10-06T04:16:56.664646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678987+0000","last_change":"2023-10-06T04:16:56.677372+0000","last_active":"2023-10-06T04:16:56.678987+0000","last_peered":"2023-10-06T04:16:56.678987+0000","last_clean":"2023-10-06T04:16:56.678987+0000","last_became_active":"2023-10-06T04:16:56.677105+0000","last_became_peered":"2023-10-06T04:16:56.677105+0000","last_unstale":"2023-10-06T04:16:56.678987+0000","last_undegraded":"2023-10-06T04:16:56.678987+0000","last_fullsized":"2023-10-06T04:16:56.678987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678358+0000","last_change":"2023-10-06T04:16:56.677091+0000","last_active":"2023-10-06T04:16:56.678358+0000","last_peered":"2023-10-06T04:16:56.678358+0000","last_clean":"2023-10-06T04:16:56.678358+0000","last_became_active":"2023-10-06T04:16:56.676847+0000","last_became_peered":"2023-10-06T04:16:56.676847+0000","last_unstale":"2023-10-06T04:16:56.678358+0000","last_undegraded":"2023-10-06T04:16:56.678358+0000","last_fullsized":"2023-10-06T04:16:56.678358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665750+0000","last_change":"2023-10-06T04:16:56.662284+0000","last_active":"2023-10-06T04:16:56.665750+0000","last_peered":"2023-10-06T04:16:56.665750+0000","last_clean":"2023-10-06T04:16:56.665750+0000","last_became_active":"2023-10-06T04:16:56.662013+0000","last_became_peered":"2023-10-06T04:16:56.662013+0000","last_unstale":"2023-10-06T04:16:56.665750+0000","last_undegraded":"2023-10-06T04:16:56.665750+0000","last_fullsized":"2023-10-06T04:16:56.665750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662752+0000","last_change":"2023-10-06T04:16:56.659881+0000","last_active":"2023-10-06T04:16:56.662752+0000","last_peered":"2023-10-06T04:16:56.662752+0000","last_clean":"2023-10-06T04:16:56.662752+0000","last_became_active":"2023-10-06T04:16:56.659565+0000","last_became_peered":"2023-10-06T04:16:56.659565+0000","last_unstale":"2023-10-06T04:16:56.662752+0000","last_undegraded":"2023-10-06T04:16:56.662752+0000","last_fullsized":"2023-10-06T04:16:56.662752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.667677+0000","last_change":"2023-10-06T04:16:56.662578+0000","last_active":"2023-10-06T04:16:56.667677+0000","last_peered":"2023-10-06T04:16:56.667677+0000","last_clean":"2023-10-06T04:16:56.667677+0000","last_became_active":"2023-10-06T04:16:56.662288+0000","last_became_peered":"2023-10-06T04:16:56.662288+0000","last_unstale":"2023-10-06T04:16:56.667677+0000","last_undegraded":"2023-10-06T04:16:56.667677+0000","last_fullsized":"2023-10-06T04:16:56.667677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.659914+0000","last_change":"2023-10-06T04:16:56.659075+0000","last_active":"2023-10-06T04:16:56.659914+0000","last_peered":"2023-10-06T04:16:56.659914+0000","last_clean":"2023-10-06T04:16:56.659914+0000","last_became_active":"2023-10-06T04:16:56.658630+0000","last_became_peered":"2023-10-06T04:16:56.658630+0000","last_unstale":"2023-10-06T04:16:56.659914+0000","last_undegraded":"2023-10-06T04:16:56.659914+0000","last_fullsized":"2023-10-06T04:16:56.659914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672766+0000","last_change":"2023-10-06T04:16:56.670918+0000","last_active":"2023-10-06T04:16:56.672766+0000","last_peered":"2023-10-06T04:16:56.672766+0000","last_clean":"2023-10-06T04:16:56.672766+0000","last_became_active":"2023-10-06T04:16:56.670638+0000","last_became_peered":"2023-10-06T04:16:56.670638+0000","last_unstale":"2023-10-06T04:16:56.672766+0000","last_undegraded":"2023-10-06T04:16:56.672766+0000","last_fullsized":"2023-10-06T04:16:56.672766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672225+0000","last_change":"2023-10-06T04:16:56.670135+0000","last_active":"2023-10-06T04:16:56.672225+0000","last_peered":"2023-10-06T04:16:56.672225+0000","last_clean":"2023-10-06T04:16:56.672225+0000","last_became_active":"2023-10-06T04:16:56.669855+0000","last_became_peered":"2023-10-06T04:16:56.669855+0000","last_unstale":"2023-10-06T04:16:56.672225+0000","last_undegraded":"2023-10-06T04:16:56.672225+0000","last_fullsized":"2023-10-06T04:16:56.672225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:49.318756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676508+0000","last_change":"2023-10-06T04:16:56.673235+0000","last_active":"2023-10-06T04:16:56.676508+0000","last_peered":"2023-10-06T04:16:56.676508+0000","last_clean":"2023-10-06T04:16:56.676508+0000","last_became_active":"2023-10-06T04:16:56.672853+0000","last_became_peered":"2023-10-06T04:16:56.672853+0000","last_unstale":"2023-10-06T04:16:56.676508+0000","last_undegraded":"2023-10-06T04:16:56.676508+0000","last_fullsized":"2023-10-06T04:16:56.676508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666241+0000","last_change":"2023-10-06T04:16:56.663344+0000","last_active":"2023-10-06T04:16:56.666241+0000","last_peered":"2023-10-06T04:16:56.666241+0000","last_clean":"2023-10-06T04:16:56.666241+0000","last_became_active":"2023-10-06T04:16:56.663082+0000","last_became_peered":"2023-10-06T04:16:56.663082+0000","last_unstale":"2023-10-06T04:16:56.666241+0000","last_undegraded":"2023-10-06T04:16:56.666241+0000","last_fullsized":"2023-10-06T04:16:56.666241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:52.653960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671682+0000","last_change":"2023-10-06T04:16:56.667309+0000","last_active":"2023-10-06T04:16:56.671682+0000","last_peered":"2023-10-06T04:16:56.671682+0000","last_clean":"2023-10-06T04:16:56.671682+0000","last_became_active":"2023-10-06T04:16:56.666994+0000","last_became_peered":"2023-10-06T04:16:56.666994+0000","last_unstale":"2023-10-06T04:16:56.671682+0000","last_undegraded":"2023-10-06T04:16:56.671682+0000","last_fullsized":"2023-10-06T04:16:56.671682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671578+0000","last_change":"2023-10-06T04:16:56.666711+0000","last_active":"2023-10-06T04:16:56.671578+0000","last_peered":"2023-10-06T04:16:56.671578+0000","last_clean":"2023-10-06T04:16:56.671578+0000","last_became_active":"2023-10-06T04:16:56.666304+0000","last_became_peered":"2023-10-06T04:16:56.666304+0000","last_unstale":"2023-10-06T04:16:56.671578+0000","last_undegraded":"2023-10-06T04:16:56.671578+0000","last_fullsized":"2023-10-06T04:16:56.671578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:42.947434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673120+0000","last_change":"2023-10-06T04:16:56.671995+0000","last_active":"2023-10-06T04:16:56.673120+0000","last_peered":"2023-10-06T04:16:56.673120+0000","last_clean":"2023-10-06T04:16:56.673120+0000","last_became_active":"2023-10-06T04:16:56.671358+0000","last_became_peered":"2023-10-06T04:16:56.671358+0000","last_unstale":"2023-10-06T04:16:56.673120+0000","last_undegraded":"2023-10-06T04:16:56.673120+0000","last_fullsized":"2023-10-06T04:16:56.673120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676631+0000","last_change":"2023-10-06T04:16:56.674623+0000","last_active":"2023-10-06T04:16:56.676631+0000","last_peered":"2023-10-06T04:16:56.676631+0000","last_clean":"2023-10-06T04:16:56.676631+0000","last_became_active":"2023-10-06T04:16:56.674251+0000","last_became_peered":"2023-10-06T04:16:56.674251+0000","last_unstale":"2023-10-06T04:16:56.676631+0000","last_undegraded":"2023-10-06T04:16:56.676631+0000","last_fullsized":"2023-10-06T04:16:56.676631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676774+0000","last_change":"2023-10-06T04:16:56.672200+0000","last_active":"2023-10-06T04:16:56.676774+0000","last_peered":"2023-10-06T04:16:56.676774+0000","last_clean":"2023-10-06T04:16:56.676774+0000","last_became_active":"2023-10-06T04:16:56.671885+0000","last_became_peered":"2023-10-06T04:16:56.671885+0000","last_unstale":"2023-10-06T04:16:56.676774+0000","last_undegraded":"2023-10-06T04:16:56.676774+0000","last_fullsized":"2023-10-06T04:16:56.676774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672217+0000","last_change":"2023-10-06T04:16:56.669907+0000","last_active":"2023-10-06T04:16:56.672217+0000","last_peered":"2023-10-06T04:16:56.672217+0000","last_clean":"2023-10-06T04:16:56.672217+0000","last_became_active":"2023-10-06T04:16:56.669630+0000","last_became_peered":"2023-10-06T04:16:56.669630+0000","last_unstale":"2023-10-06T04:16:56.672217+0000","last_undegraded":"2023-10-06T04:16:56.672217+0000","last_fullsized":"2023-10-06T04:16:56.672217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671424+0000","last_change":"2023-10-06T04:16:56.667673+0000","last_active":"2023-10-06T04:16:56.671424+0000","last_peered":"2023-10-06T04:16:56.671424+0000","last_clean":"2023-10-06T04:16:56.671424+0000","last_became_active":"2023-10-06T04:16:56.667408+0000","last_became_peered":"2023-10-06T04:16:56.667408+0000","last_unstale":"2023-10-06T04:16:56.671424+0000","last_undegraded":"2023-10-06T04:16:56.671424+0000","last_fullsized":"2023-10-06T04:16:56.671424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669519+0000","last_change":"2023-10-06T04:16:56.665187+0000","last_active":"2023-10-06T04:16:56.669519+0000","last_peered":"2023-10-06T04:16:56.669519+0000","last_clean":"2023-10-06T04:16:56.669519+0000","last_became_active":"2023-10-06T04:16:56.664852+0000","last_became_peered":"2023-10-06T04:16:56.664852+0000","last_unstale":"2023-10-06T04:16:56.669519+0000","last_undegraded":"2023-10-06T04:16:56.669519+0000","last_fullsized":"2023-10-06T04:16:56.669519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669427+0000","last_change":"2023-10-06T04:16:56.665892+0000","last_active":"2023-10-06T04:16:56.669427+0000","last_peered":"2023-10-06T04:16:56.669427+0000","last_clean":"2023-10-06T04:16:56.669427+0000","last_became_active":"2023-10-06T04:16:56.665587+0000","last_became_peered":"2023-10-06T04:16:56.665587+0000","last_unstale":"2023-10-06T04:16:56.669427+0000","last_undegraded":"2023-10-06T04:16:56.669427+0000","last_fullsized":"2023-10-06T04:16:56.669427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.690846+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:56.690846+0000","last_peered":"2023-10-06T04:16:56.690846+0000","last_clean":"2023-10-06T04:16:56.690846+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:56.690846+0000","last_undegraded":"2023-10-06T04:16:56.690846+0000","last_fullsized":"2023-10-06T04:16:56.690846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676137+0000","last_change":"2023-10-06T04:16:56.669519+0000","last_active":"2023-10-06T04:16:56.676137+0000","last_peered":"2023-10-06T04:16:56.676137+0000","last_clean":"2023-10-06T04:16:56.676137+0000","last_became_active":"2023-10-06T04:16:56.669197+0000","last_became_peered":"2023-10-06T04:16:56.669197+0000","last_unstale":"2023-10-06T04:16:56.676137+0000","last_undegraded":"2023-10-06T04:16:56.676137+0000","last_fullsized":"2023-10-06T04:16:56.676137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658364+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:56.658364+0000","last_peered":"2023-10-06T04:16:56.658364+0000","last_clean":"2023-10-06T04:16:56.658364+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:56.658364+0000","last_undegraded":"2023-10-06T04:16:56.658364+0000","last_fullsized":"2023-10-06T04:16:56.658364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677416+0000","last_change":"2023-10-06T04:16:56.673577+0000","last_active":"2023-10-06T04:16:56.677416+0000","last_peered":"2023-10-06T04:16:56.677416+0000","last_clean":"2023-10-06T04:16:56.677416+0000","last_became_active":"2023-10-06T04:16:56.672105+0000","last_became_peered":"2023-10-06T04:16:56.672105+0000","last_unstale":"2023-10-06T04:16:56.677416+0000","last_undegraded":"2023-10-06T04:16:56.677416+0000","last_fullsized":"2023-10-06T04:16:56.677416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657761+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:56.657761+0000","last_peered":"2023-10-06T04:16:56.657761+0000","last_clean":"2023-10-06T04:16:56.657761+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:56.657761+0000","last_undegraded":"2023-10-06T04:16:56.657761+0000","last_fullsized":"2023-10-06T04:16:56.657761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672585+0000","last_change":"2023-10-06T04:16:56.669053+0000","last_active":"2023-10-06T04:16:56.672585+0000","last_peered":"2023-10-06T04:16:56.672585+0000","last_clean":"2023-10-06T04:16:56.672585+0000","last_became_active":"2023-10-06T04:16:56.668550+0000","last_became_peered":"2023-10-06T04:16:56.668550+0000","last_unstale":"2023-10-06T04:16:56.672585+0000","last_undegraded":"2023-10-06T04:16:56.672585+0000","last_fullsized":"2023-10-06T04:16:56.672585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663592+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:56.663592+0000","last_peered":"2023-10-06T04:16:56.663592+0000","last_clean":"2023-10-06T04:16:56.663592+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:56.663592+0000","last_undegraded":"2023-10-06T04:16:56.663592+0000","last_fullsized":"2023-10-06T04:16:56.663592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676739+0000","last_change":"2023-10-06T04:16:56.673953+0000","last_active":"2023-10-06T04:16:56.676739+0000","last_peered":"2023-10-06T04:16:56.676739+0000","last_clean":"2023-10-06T04:16:56.676739+0000","last_became_active":"2023-10-06T04:16:56.672796+0000","last_became_peered":"2023-10-06T04:16:56.672796+0000","last_unstale":"2023-10-06T04:16:56.676739+0000","last_undegraded":"2023-10-06T04:16:56.676739+0000","last_fullsized":"2023-10-06T04:16:56.676739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655148+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:56.655148+0000","last_peered":"2023-10-06T04:16:56.655148+0000","last_clean":"2023-10-06T04:16:56.655148+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:56.655148+0000","last_undegraded":"2023-10-06T04:16:56.655148+0000","last_fullsized":"2023-10-06T04:16:56.655148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676749+0000","last_change":"2023-10-06T04:16:56.671605+0000","last_active":"2023-10-06T04:16:56.676749+0000","last_peered":"2023-10-06T04:16:56.676749+0000","last_clean":"2023-10-06T04:16:56.676749+0000","last_became_active":"2023-10-06T04:16:56.670359+0000","last_became_peered":"2023-10-06T04:16:56.670359+0000","last_unstale":"2023-10-06T04:16:56.676749+0000","last_undegraded":"2023-10-06T04:16:56.676749+0000","last_fullsized":"2023-10-06T04:16:56.676749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694597+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:56.694597+0000","last_peered":"2023-10-06T04:16:56.694597+0000","last_clean":"2023-10-06T04:16:56.694597+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:56.694597+0000","last_undegraded":"2023-10-06T04:16:56.694597+0000","last_fullsized":"2023-10-06T04:16:56.694597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671837+0000","last_change":"2023-10-06T04:16:56.666797+0000","last_active":"2023-10-06T04:16:56.671837+0000","last_peered":"2023-10-06T04:16:56.671837+0000","last_clean":"2023-10-06T04:16:56.671837+0000","last_became_active":"2023-10-06T04:16:56.666505+0000","last_became_peered":"2023-10-06T04:16:56.666505+0000","last_unstale":"2023-10-06T04:16:56.671837+0000","last_undegraded":"2023-10-06T04:16:56.671837+0000","last_fullsized":"2023-10-06T04:16:56.671837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694444+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:56.694444+0000","last_peered":"2023-10-06T04:16:56.694444+0000","last_clean":"2023-10-06T04:16:56.694444+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:56.694444+0000","last_undegraded":"2023-10-06T04:16:56.694444+0000","last_fullsized":"2023-10-06T04:16:56.694444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672149+0000","last_change":"2023-10-06T04:16:56.668378+0000","last_active":"2023-10-06T04:16:56.672149+0000","last_peered":"2023-10-06T04:16:56.672149+0000","last_clean":"2023-10-06T04:16:56.672149+0000","last_became_active":"2023-10-06T04:16:56.668083+0000","last_became_peered":"2023-10-06T04:16:56.668083+0000","last_unstale":"2023-10-06T04:16:56.672149+0000","last_undegraded":"2023-10-06T04:16:56.672149+0000","last_fullsized":"2023-10-06T04:16:56.672149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:03.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692795+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:56.692795+0000","last_peered":"2023-10-06T04:16:56.692795+0000","last_clean":"2023-10-06T04:16:56.692795+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:56.692795+0000","last_undegraded":"2023-10-06T04:16:56.692795+0000","last_fullsized":"2023-10-06T04:16:56.692795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676685+0000","last_change":"2023-10-06T04:16:56.671592+0000","last_active":"2023-10-06T04:16:56.676685+0000","last_peered":"2023-10-06T04:16:56.676685+0000","last_clean":"2023-10-06T04:16:56.676685+0000","last_became_active":"2023-10-06T04:16:56.671299+0000","last_became_peered":"2023-10-06T04:16:56.671299+0000","last_unstale":"2023-10-06T04:16:56.676685+0000","last_undegraded":"2023-10-06T04:16:56.676685+0000","last_fullsized":"2023-10-06T04:16:56.676685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668158+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:56.668158+0000","last_peered":"2023-10-06T04:16:56.668158+0000","last_clean":"2023-10-06T04:16:56.668158+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:56.668158+0000","last_undegraded":"2023-10-06T04:16:56.668158+0000","last_fullsized":"2023-10-06T04:16:56.668158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669445+0000","last_change":"2023-10-06T04:16:56.665896+0000","last_active":"2023-10-06T04:16:56.669445+0000","last_peered":"2023-10-06T04:16:56.669445+0000","last_clean":"2023-10-06T04:16:56.669445+0000","last_became_active":"2023-10-06T04:16:56.665600+0000","last_became_peered":"2023-10-06T04:16:56.665600+0000","last_unstale":"2023-10-06T04:16:56.669445+0000","last_undegraded":"2023-10-06T04:16:56.669445+0000","last_fullsized":"2023-10-06T04:16:56.669445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662564+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:56.662564+0000","last_peered":"2023-10-06T04:16:56.662564+0000","last_clean":"2023-10-06T04:16:56.662564+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:56.662564+0000","last_undegraded":"2023-10-06T04:16:56.662564+0000","last_fullsized":"2023-10-06T04:16:56.662564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677435+0000","last_change":"2023-10-06T04:16:56.673632+0000","last_active":"2023-10-06T04:16:56.677435+0000","last_peered":"2023-10-06T04:16:56.677435+0000","last_clean":"2023-10-06T04:16:56.677435+0000","last_became_active":"2023-10-06T04:16:56.673351+0000","last_became_peered":"2023-10-06T04:16:56.673351+0000","last_unstale":"2023-10-06T04:16:56.677435+0000","last_undegraded":"2023-10-06T04:16:56.677435+0000","last_fullsized":"2023-10-06T04:16:56.677435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.695221+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:56.695221+0000","last_peered":"2023-10-06T04:16:56.695221+0000","last_clean":"2023-10-06T04:16:56.695221+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:56.695221+0000","last_undegraded":"2023-10-06T04:16:56.695221+0000","last_fullsized":"2023-10-06T04:16:56.695221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676351+0000","last_change":"2023-10-06T04:16:56.670186+0000","last_active":"2023-10-06T04:16:56.676351+0000","last_peered":"2023-10-06T04:16:56.676351+0000","last_clean":"2023-10-06T04:16:56.676351+0000","last_became_active":"2023-10-06T04:16:56.669792+0000","last_became_peered":"2023-10-06T04:16:56.669792+0000","last_unstale":"2023-10-06T04:16:56.676351+0000","last_undegraded":"2023-10-06T04:16:56.676351+0000","last_fullsized":"2023-10-06T04:16:56.676351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692671+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:56.692671+0000","last_peered":"2023-10-06T04:16:56.692671+0000","last_clean":"2023-10-06T04:16:56.692671+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:56.692671+0000","last_undegraded":"2023-10-06T04:16:56.692671+0000","last_fullsized":"2023-10-06T04:16:56.692671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669397+0000","last_change":"2023-10-06T04:16:56.666338+0000","last_active":"2023-10-06T04:16:56.669397+0000","last_peered":"2023-10-06T04:16:56.669397+0000","last_clean":"2023-10-06T04:16:56.669397+0000","last_became_active":"2023-10-06T04:16:56.666070+0000","last_became_peered":"2023-10-06T04:16:56.666070+0000","last_unstale":"2023-10-06T04:16:56.669397+0000","last_undegraded":"2023-10-06T04:16:56.669397+0000","last_fullsized":"2023-10-06T04:16:56.669397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692755+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:56.692755+0000","last_peered":"2023-10-06T04:16:56.692755+0000","last_clean":"2023-10-06T04:16:56.692755+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:56.692755+0000","last_undegraded":"2023-10-06T04:16:56.692755+0000","last_fullsized":"2023-10-06T04:16:56.692755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670632+0000","last_change":"2023-10-06T04:16:56.665346+0000","last_active":"2023-10-06T04:16:56.670632+0000","last_peered":"2023-10-06T04:16:56.670632+0000","last_clean":"2023-10-06T04:16:56.670632+0000","last_became_active":"2023-10-06T04:16:56.665106+0000","last_became_peered":"2023-10-06T04:16:56.665106+0000","last_unstale":"2023-10-06T04:16:56.670632+0000","last_undegraded":"2023-10-06T04:16:56.670632+0000","last_fullsized":"2023-10-06T04:16:56.670632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:08.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693453+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:56.693453+0000","last_peered":"2023-10-06T04:16:56.693453+0000","last_clean":"2023-10-06T04:16:56.693453+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:56.693453+0000","last_undegraded":"2023-10-06T04:16:56.693453+0000","last_fullsized":"2023-10-06T04:16:56.693453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674138+0000","last_change":"2023-10-06T04:16:56.672813+0000","last_active":"2023-10-06T04:16:56.674138+0000","last_peered":"2023-10-06T04:16:56.674138+0000","last_clean":"2023-10-06T04:16:56.674138+0000","last_became_active":"2023-10-06T04:16:56.672433+0000","last_became_peered":"2023-10-06T04:16:56.672433+0000","last_unstale":"2023-10-06T04:16:56.674138+0000","last_undegraded":"2023-10-06T04:16:56.674138+0000","last_fullsized":"2023-10-06T04:16:56.674138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653810+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:56.653810+0000","last_peered":"2023-10-06T04:16:56.653810+0000","last_clean":"2023-10-06T04:16:56.653810+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:56.653810+0000","last_undegraded":"2023-10-06T04:16:56.653810+0000","last_fullsized":"2023-10-06T04:16:56.653810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676608+0000","last_change":"2023-10-06T04:16:56.675176+0000","last_active":"2023-10-06T04:16:56.676608+0000","last_peered":"2023-10-06T04:16:56.676608+0000","last_clean":"2023-10-06T04:16:56.676608+0000","last_became_active":"2023-10-06T04:16:56.674871+0000","last_became_peered":"2023-10-06T04:16:56.674871+0000","last_unstale":"2023-10-06T04:16:56.676608+0000","last_undegraded":"2023-10-06T04:16:56.676608+0000","last_fullsized":"2023-10-06T04:16:56.676608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691464+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:56.691464+0000","last_peered":"2023-10-06T04:16:56.691464+0000","last_clean":"2023-10-06T04:16:56.691464+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:56.691464+0000","last_undegraded":"2023-10-06T04:16:56.691464+0000","last_fullsized":"2023-10-06T04:16:56.691464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666039+0000","last_change":"2023-10-06T04:16:56.664308+0000","last_active":"2023-10-06T04:16:56.666039+0000","last_peered":"2023-10-06T04:16:56.666039+0000","last_clean":"2023-10-06T04:16:56.666039+0000","last_became_active":"2023-10-06T04:16:56.664011+0000","last_became_peered":"2023-10-06T04:16:56.664011+0000","last_unstale":"2023-10-06T04:16:56.666039+0000","last_undegraded":"2023-10-06T04:16:56.666039+0000","last_fullsized":"2023-10-06T04:16:56.666039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:49.601120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663190+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:56.663190+0000","last_peered":"2023-10-06T04:16:56.663190+0000","last_clean":"2023-10-06T04:16:56.663190+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:56.663190+0000","last_undegraded":"2023-10-06T04:16:56.663190+0000","last_fullsized":"2023-10-06T04:16:56.663190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666606+0000","last_change":"2023-10-06T04:16:56.664458+0000","last_active":"2023-10-06T04:16:56.666606+0000","last_peered":"2023-10-06T04:16:56.666606+0000","last_clean":"2023-10-06T04:16:56.666606+0000","last_became_active":"2023-10-06T04:16:56.664213+0000","last_became_peered":"2023-10-06T04:16:56.664213+0000","last_unstale":"2023-10-06T04:16:56.666606+0000","last_undegraded":"2023-10-06T04:16:56.666606+0000","last_fullsized":"2023-10-06T04:16:56.666606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655273+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:56.655273+0000","last_peered":"2023-10-06T04:16:56.655273+0000","last_clean":"2023-10-06T04:16:56.655273+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:56.655273+0000","last_undegraded":"2023-10-06T04:16:56.655273+0000","last_fullsized":"2023-10-06T04:16:56.655273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672175+0000","last_change":"2023-10-06T04:16:56.668413+0000","last_active":"2023-10-06T04:16:56.672175+0000","last_peered":"2023-10-06T04:16:56.672175+0000","last_clean":"2023-10-06T04:16:56.672175+0000","last_became_active":"2023-10-06T04:16:56.668093+0000","last_became_peered":"2023-10-06T04:16:56.668093+0000","last_unstale":"2023-10-06T04:16:56.672175+0000","last_undegraded":"2023-10-06T04:16:56.672175+0000","last_fullsized":"2023-10-06T04:16:56.672175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657650+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:56.657650+0000","last_peered":"2023-10-06T04:16:56.657650+0000","last_clean":"2023-10-06T04:16:56.657650+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:56.657650+0000","last_undegraded":"2023-10-06T04:16:56.657650+0000","last_fullsized":"2023-10-06T04:16:56.657650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673361+0000","last_change":"2023-10-06T04:16:56.671285+0000","last_active":"2023-10-06T04:16:56.673361+0000","last_peered":"2023-10-06T04:16:56.673361+0000","last_clean":"2023-10-06T04:16:56.673361+0000","last_became_active":"2023-10-06T04:16:56.671009+0000","last_became_peered":"2023-10-06T04:16:56.671009+0000","last_unstale":"2023-10-06T04:16:56.673361+0000","last_undegraded":"2023-10-06T04:16:56.673361+0000","last_fullsized":"2023-10-06T04:16:56.673361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658750+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:56.658750+0000","last_peered":"2023-10-06T04:16:56.658750+0000","last_clean":"2023-10-06T04:16:56.658750+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:56.658750+0000","last_undegraded":"2023-10-06T04:16:56.658750+0000","last_fullsized":"2023-10-06T04:16:56.658750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657337+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:56.657337+0000","last_peered":"2023-10-06T04:16:56.657337+0000","last_clean":"2023-10-06T04:16:56.657337+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:56.657337+0000","last_undegraded":"2023-10-06T04:16:56.657337+0000","last_fullsized":"2023-10-06T04:16:56.657337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671795+0000","last_change":"2023-10-06T04:16:56.660763+0000","last_active":"2023-10-06T04:16:56.671795+0000","last_peered":"2023-10-06T04:16:56.671795+0000","last_clean":"2023-10-06T04:16:56.671795+0000","last_became_active":"2023-10-06T04:16:56.660470+0000","last_became_peered":"2023-10-06T04:16:56.660470+0000","last_unstale":"2023-10-06T04:16:56.671795+0000","last_undegraded":"2023-10-06T04:16:56.671795+0000","last_fullsized":"2023-10-06T04:16:56.671795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669999+0000","last_change":"2023-10-06T04:16:56.665106+0000","last_active":"2023-10-06T04:16:56.669999+0000","last_peered":"2023-10-06T04:16:56.669999+0000","last_clean":"2023-10-06T04:16:56.669999+0000","last_became_active":"2023-10-06T04:16:56.664811+0000","last_became_peered":"2023-10-06T04:16:56.664811+0000","last_unstale":"2023-10-06T04:16:56.669999+0000","last_undegraded":"2023-10-06T04:16:56.669999+0000","last_fullsized":"2023-10-06T04:16:56.669999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.652014+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:56.652014+0000","last_peered":"2023-10-06T04:16:56.652014+0000","last_clean":"2023-10-06T04:16:56.652014+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:56.652014+0000","last_undegraded":"2023-10-06T04:16:56.652014+0000","last_fullsized":"2023-10-06T04:16:56.652014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658314+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:56.658314+0000","last_peered":"2023-10-06T04:16:56.658314+0000","last_clean":"2023-10-06T04:16:56.658314+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:56.658314+0000","last_undegraded":"2023-10-06T04:16:56.658314+0000","last_fullsized":"2023-10-06T04:16:56.658314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668964+0000","last_change":"2023-10-06T04:16:56.661671+0000","last_active":"2023-10-06T04:16:56.668964+0000","last_peered":"2023-10-06T04:16:56.668964+0000","last_clean":"2023-10-06T04:16:56.668964+0000","last_became_active":"2023-10-06T04:16:56.660697+0000","last_became_peered":"2023-10-06T04:16:56.660697+0000","last_unstale":"2023-10-06T04:16:56.668964+0000","last_undegraded":"2023-10-06T04:16:56.668964+0000","last_fullsized":"2023-10-06T04:16:56.668964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653351+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:56.653351+0000","last_peered":"2023-10-06T04:16:56.653351+0000","last_clean":"2023-10-06T04:16:56.653351+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:56.653351+0000","last_undegraded":"2023-10-06T04:16:56.653351+0000","last_fullsized":"2023-10-06T04:16:56.653351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660306+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:56.660306+0000","last_peered":"2023-10-06T04:16:56.660306+0000","last_clean":"2023-10-06T04:16:56.660306+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:56.660306+0000","last_undegraded":"2023-10-06T04:16:56.660306+0000","last_fullsized":"2023-10-06T04:16:56.660306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655543+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:56.655543+0000","last_peered":"2023-10-06T04:16:56.655543+0000","last_clean":"2023-10-06T04:16:56.655543+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:56.655543+0000","last_undegraded":"2023-10-06T04:16:56.655543+0000","last_fullsized":"2023-10-06T04:16:56.655543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672541+0000","last_change":"2023-10-06T04:16:56.671575+0000","last_active":"2023-10-06T04:16:56.672541+0000","last_peered":"2023-10-06T04:16:56.672541+0000","last_clean":"2023-10-06T04:16:56.672541+0000","last_became_active":"2023-10-06T04:16:56.671276+0000","last_became_peered":"2023-10-06T04:16:56.671276+0000","last_unstale":"2023-10-06T04:16:56.672541+0000","last_undegraded":"2023-10-06T04:16:56.672541+0000","last_fullsized":"2023-10-06T04:16:56.672541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660411+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:56.660411+0000","last_peered":"2023-10-06T04:16:56.660411+0000","last_clean":"2023-10-06T04:16:56.660411+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:56.660411+0000","last_undegraded":"2023-10-06T04:16:56.660411+0000","last_fullsized":"2023-10-06T04:16:56.660411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664829+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:56.664829+0000","last_peered":"2023-10-06T04:16:56.664829+0000","last_clean":"2023-10-06T04:16:56.664829+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:56.664829+0000","last_undegraded":"2023-10-06T04:16:56.664829+0000","last_fullsized":"2023-10-06T04:16:56.664829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678965+0000","last_change":"2023-10-06T04:16:56.677307+0000","last_active":"2023-10-06T04:16:56.678965+0000","last_peered":"2023-10-06T04:16:56.678965+0000","last_clean":"2023-10-06T04:16:56.678965+0000","last_became_active":"2023-10-06T04:16:56.676460+0000","last_became_peered":"2023-10-06T04:16:56.676460+0000","last_unstale":"2023-10-06T04:16:56.678965+0000","last_undegraded":"2023-10-06T04:16:56.678965+0000","last_fullsized":"2023-10-06T04:16:56.678965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663629+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:56.663629+0000","last_peered":"2023-10-06T04:16:56.663629+0000","last_clean":"2023-10-06T04:16:56.663629+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:56.663629+0000","last_undegraded":"2023-10-06T04:16:56.663629+0000","last_fullsized":"2023-10-06T04:16:56.663629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658864+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:56.658864+0000","last_peered":"2023-10-06T04:16:56.658864+0000","last_clean":"2023-10-06T04:16:56.658864+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:56.658864+0000","last_undegraded":"2023-10-06T04:16:56.658864+0000","last_fullsized":"2023-10-06T04:16:56.658864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676108+0000","last_change":"2023-10-06T04:16:56.669292+0000","last_active":"2023-10-06T04:16:56.676108+0000","last_peered":"2023-10-06T04:16:56.676108+0000","last_clean":"2023-10-06T04:16:56.676108+0000","last_became_active":"2023-10-06T04:16:56.668986+0000","last_became_peered":"2023-10-06T04:16:56.668986+0000","last_unstale":"2023-10-06T04:16:56.676108+0000","last_undegraded":"2023-10-06T04:16:56.676108+0000","last_fullsized":"2023-10-06T04:16:56.676108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692290+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:56.692290+0000","last_peered":"2023-10-06T04:16:56.692290+0000","last_clean":"2023-10-06T04:16:56.692290+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:56.692290+0000","last_undegraded":"2023-10-06T04:16:56.692290+0000","last_fullsized":"2023-10-06T04:16:56.692290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658866+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:56.658866+0000","last_peered":"2023-10-06T04:16:56.658866+0000","last_clean":"2023-10-06T04:16:56.658866+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:56.658866+0000","last_undegraded":"2023-10-06T04:16:56.658866+0000","last_fullsized":"2023-10-06T04:16:56.658866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676714+0000","last_change":"2023-10-06T04:16:56.673874+0000","last_active":"2023-10-06T04:16:56.676714+0000","last_peered":"2023-10-06T04:16:56.676714+0000","last_clean":"2023-10-06T04:16:56.676714+0000","last_became_active":"2023-10-06T04:16:56.673236+0000","last_became_peered":"2023-10-06T04:16:56.673236+0000","last_unstale":"2023-10-06T04:16:56.676714+0000","last_undegraded":"2023-10-06T04:16:56.676714+0000","last_fullsized":"2023-10-06T04:16:56.676714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662103+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:56.662103+0000","last_peered":"2023-10-06T04:16:56.662103+0000","last_clean":"2023-10-06T04:16:56.662103+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:56.662103+0000","last_undegraded":"2023-10-06T04:16:56.662103+0000","last_fullsized":"2023-10-06T04:16:56.662103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T04:16:57.674758+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:57.674758+0000","last_peered":"2023-10-06T04:16:57.674758+0000","last_clean":"2023-10-06T04:16:57.674758+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:57.674758+0000","last_undegraded":"2023-10-06T04:16:57.674758+0000","last_fullsized":"2023-10-06T04:16:57.674758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665712+0000","last_change":"2023-10-06T04:16:56.659978+0000","last_active":"2023-10-06T04:16:56.665712+0000","last_peered":"2023-10-06T04:16:56.665712+0000","last_clean":"2023-10-06T04:16:56.665712+0000","last_became_active":"2023-10-06T04:16:56.659701+0000","last_became_peered":"2023-10-06T04:16:56.659701+0000","last_unstale":"2023-10-06T04:16:56.665712+0000","last_undegraded":"2023-10-06T04:16:56.665712+0000","last_fullsized":"2023-10-06T04:16:56.665712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691318+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:56.691318+0000","last_peered":"2023-10-06T04:16:56.691318+0000","last_clean":"2023-10-06T04:16:56.691318+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:56.691318+0000","last_undegraded":"2023-10-06T04:16:56.691318+0000","last_fullsized":"2023-10-06T04:16:56.691318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673783+0000","last_change":"2023-10-06T04:16:56.666213+0000","last_active":"2023-10-06T04:16:56.673783+0000","last_peered":"2023-10-06T04:16:56.673783+0000","last_clean":"2023-10-06T04:16:56.673783+0000","last_became_active":"2023-10-06T04:16:56.665929+0000","last_became_peered":"2023-10-06T04:16:56.665929+0000","last_unstale":"2023-10-06T04:16:56.673783+0000","last_undegraded":"2023-10-06T04:16:56.673783+0000","last_fullsized":"2023-10-06T04:16:56.673783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691805+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:56.691805+0000","last_peered":"2023-10-06T04:16:56.691805+0000","last_clean":"2023-10-06T04:16:56.691805+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:56.691805+0000","last_undegraded":"2023-10-06T04:16:56.691805+0000","last_fullsized":"2023-10-06T04:16:56.691805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665999+0000","last_change":"2023-10-06T04:16:56.663079+0000","last_active":"2023-10-06T04:16:56.665999+0000","last_peered":"2023-10-06T04:16:56.665999+0000","last_clean":"2023-10-06T04:16:56.665999+0000","last_became_active":"2023-10-06T04:16:56.662838+0000","last_became_peered":"2023-10-06T04:16:56.662838+0000","last_unstale":"2023-10-06T04:16:56.665999+0000","last_undegraded":"2023-10-06T04:16:56.665999+0000","last_fullsized":"2023-10-06T04:16:56.665999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:22.046890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691400+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:56.691400+0000","last_peered":"2023-10-06T04:16:56.691400+0000","last_clean":"2023-10-06T04:16:56.691400+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:56.691400+0000","last_undegraded":"2023-10-06T04:16:56.691400+0000","last_fullsized":"2023-10-06T04:16:56.691400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666210+0000","last_change":"2023-10-06T04:16:56.664312+0000","last_active":"2023-10-06T04:16:56.666210+0000","last_peered":"2023-10-06T04:16:56.666210+0000","last_clean":"2023-10-06T04:16:56.666210+0000","last_became_active":"2023-10-06T04:16:56.664028+0000","last_became_peered":"2023-10-06T04:16:56.664028+0000","last_unstale":"2023-10-06T04:16:56.666210+0000","last_undegraded":"2023-10-06T04:16:56.666210+0000","last_fullsized":"2023-10-06T04:16:56.666210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.688921+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:56.688921+0000","last_peered":"2023-10-06T04:16:56.688921+0000","last_clean":"2023-10-06T04:16:56.688921+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:56.688921+0000","last_undegraded":"2023-10-06T04:16:56.688921+0000","last_fullsized":"2023-10-06T04:16:56.688921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670590+0000","last_change":"2023-10-06T04:16:56.666518+0000","last_active":"2023-10-06T04:16:56.670590+0000","last_peered":"2023-10-06T04:16:56.670590+0000","last_clean":"2023-10-06T04:16:56.670590+0000","last_became_active":"2023-10-06T04:16:56.666210+0000","last_became_peered":"2023-10-06T04:16:56.666210+0000","last_unstale":"2023-10-06T04:16:56.670590+0000","last_undegraded":"2023-10-06T04:16:56.670590+0000","last_fullsized":"2023-10-06T04:16:56.670590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693693+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:56.693693+0000","last_peered":"2023-10-06T04:16:56.693693+0000","last_clean":"2023-10-06T04:16:56.693693+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:56.693693+0000","last_undegraded":"2023-10-06T04:16:56.693693+0000","last_fullsized":"2023-10-06T04:16:56.693693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671474+0000","last_change":"2023-10-06T04:16:56.666522+0000","last_active":"2023-10-06T04:16:56.671474+0000","last_peered":"2023-10-06T04:16:56.671474+0000","last_clean":"2023-10-06T04:16:56.671474+0000","last_became_active":"2023-10-06T04:16:56.666259+0000","last_became_peered":"2023-10-06T04:16:56.666259+0000","last_unstale":"2023-10-06T04:16:56.671474+0000","last_undegraded":"2023-10-06T04:16:56.671474+0000","last_fullsized":"2023-10-06T04:16:56.671474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674341+0000","last_change":"2023-10-06T04:16:56.672889+0000","last_active":"2023-10-06T04:16:56.674341+0000","last_peered":"2023-10-06T04:16:56.674341+0000","last_clean":"2023-10-06T04:16:56.674341+0000","last_became_active":"2023-10-06T04:16:56.672585+0000","last_became_peered":"2023-10-06T04:16:56.672585+0000","last_unstale":"2023-10-06T04:16:56.674341+0000","last_undegraded":"2023-10-06T04:16:56.674341+0000","last_fullsized":"2023-10-06T04:16:56.674341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676761+0000","last_change":"2023-10-06T04:16:56.671951+0000","last_active":"2023-10-06T04:16:56.676761+0000","last_peered":"2023-10-06T04:16:56.676761+0000","last_clean":"2023-10-06T04:16:56.676761+0000","last_became_active":"2023-10-06T04:16:56.671467+0000","last_became_peered":"2023-10-06T04:16:56.671467+0000","last_unstale":"2023-10-06T04:16:56.676761+0000","last_undegraded":"2023-10-06T04:16:56.676761+0000","last_fullsized":"2023-10-06T04:16:56.676761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672197+0000","last_change":"2023-10-06T04:16:56.668427+0000","last_active":"2023-10-06T04:16:56.672197+0000","last_peered":"2023-10-06T04:16:56.672197+0000","last_clean":"2023-10-06T04:16:56.672197+0000","last_became_active":"2023-10-06T04:16:56.668119+0000","last_became_peered":"2023-10-06T04:16:56.668119+0000","last_unstale":"2023-10-06T04:16:56.672197+0000","last_undegraded":"2023-10-06T04:16:56.672197+0000","last_fullsized":"2023-10-06T04:16:56.672197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676893+0000","last_change":"2023-10-06T04:16:56.670079+0000","last_active":"2023-10-06T04:16:56.676893+0000","last_peered":"2023-10-06T04:16:56.676893+0000","last_clean":"2023-10-06T04:16:56.676893+0000","last_became_active":"2023-10-06T04:16:56.669692+0000","last_became_peered":"2023-10-06T04:16:56.669692+0000","last_unstale":"2023-10-06T04:16:56.676893+0000","last_undegraded":"2023-10-06T04:16:56.676893+0000","last_fullsized":"2023-10-06T04:16:56.676893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671532+0000","last_change":"2023-10-06T04:16:56.669243+0000","last_active":"2023-10-06T04:16:56.671532+0000","last_peered":"2023-10-06T04:16:56.671532+0000","last_clean":"2023-10-06T04:16:56.671532+0000","last_became_active":"2023-10-06T04:16:56.668889+0000","last_became_peered":"2023-10-06T04:16:56.668889+0000","last_unstale":"2023-10-06T04:16:56.671532+0000","last_undegraded":"2023-10-06T04:16:56.671532+0000","last_fullsized":"2023-10-06T04:16:56.671532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":681439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":680241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":245760,"data_stored":89409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":90911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":89943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:05.735 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:17:05.735 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:17:05.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:17:05.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:17:05.736 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:17:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.886+0000 7fe5a43d1700 1 Processor -- start 2023-10-06T04:17:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.886+0000 7fe5a43d1700 1 -- start start 2023-10-06T04:17:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.886+0000 7fe5a43d1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.886+0000 7fe5a43d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a43d1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0ae9f0 con 0x7fe59c0ad0f0 2023-10-06T04:17:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a43d1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0adde0 con 0x7fe59c0b5e30 2023-10-06T04:17:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a43d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0ae0c0 con 0x7fe59c0b6200 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a216d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a216d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:38922/0 (socket says 172.21.15.37:38922) 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a216d700 1 -- 172.21.15.37:0/1372786167 learned_addr learned my addr 172.21.15.37:0/1372786167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:50620/0 (socket says 172.21.15.37:50620) 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a296e700 1 --1- 172.21.15.37:0/1372786167 >> v1:172.21.15.83:6789/0 conn(0x7fe59c0ad0f0 0x7fe59c0ad570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:45018/0 (socket says 172.21.15.37:45018) 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 -- 172.21.15.37:0/1372786167 >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 msgr2=0x7fe59c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 --2- 172.21.15.37:0/1372786167 >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 -- 172.21.15.37:0/1372786167 >> v1:172.21.15.83:6789/0 conn(0x7fe59c0ad0f0 legacy=0x7fe59c0ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 -- 172.21.15.37:0/1372786167 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0ae3a0 con 0x7fe59c0b6200 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a216d700 1 --2- 172.21.15.37:0/1372786167 >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.887+0000 7fe5a196c700 1 --2- 172.21.15.37:0/1372786167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5900098e0 tx=0x7fe5900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec67a1c35dfb936 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a116b700 1 -- 172.21.15.37:0/1372786167 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000b640 con 0x7fe59c0b6200 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a116b700 1 -- 172.21.15.37:0/1372786167 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59000b7a0 con 0x7fe59c0b6200 2023-10-06T04:17:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a116b700 1 -- 172.21.15.37:0/1372786167 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000bb40 con 0x7fe59c0b6200 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 -- 172.21.15.37:0/1372786167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 msgr2=0x7fe59c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/1372786167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5900098e0 tx=0x7fe5900091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 -- 172.21.15.37:0/1372786167 shutdown_connections 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/1372786167 >> v2:172.21.15.83:3300/0 conn(0x7fe59c0b5e30 0x7fe59c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/1372786167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0b6200 0x7fe59c15daa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 -- 172.21.15.37:0/1372786167 >> 172.21.15.37:0/1372786167 conn(0x7fe59c099a10 msgr2=0x7fe59c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 -- 172.21.15.37:0/1372786167 shutdown_connections 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.888+0000 7fe5a43d1700 1 -- 172.21.15.37:0/1372786167 wait complete. 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.889+0000 7fe5a43d1700 1 Processor -- start 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.889+0000 7fe5a43d1700 1 -- start start 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0ad0f0 0x7fe59c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe59c0b6200 0x7fe59c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c09b490 con 0x7fe59c0b5e30 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c153a30 con 0x7fe59c0b6200 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a43d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c09b730 con 0x7fe59c0ad0f0 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54410/0 (socket says 172.21.15.37:54410) 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 -- 172.21.15.37:0/3242075502 learned_addr learned my addr 172.21.15.37:0/3242075502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a216d700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0ad0f0 0x7fe59c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a296e700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe59c0b6200 0x7fe59c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 -- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0ad0f0 msgr2=0x7fe59c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0ad0f0 0x7fe59c1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 -- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe59c0b6200 msgr2=0x7fe59c158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe59c0b6200 0x7fe59c158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.890+0000 7fe5a196c700 1 -- 172.21.15.37:0/3242075502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0094f0 con 0x7fe59c0b5e30 2023-10-06T04:17:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe5a196c700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe590009f80 tx=0x7fe590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000bb20 con 0x7fe59c0b5e30 2023-10-06T04:17:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590000c40 con 0x7fe59c0b5e30 2023-10-06T04:17:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590009420 con 0x7fe59c0b5e30 2023-10-06T04:17:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011650 con 0x7fe59c0b5e30 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.891+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c153470 con 0x7fe59c0b5e30 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.892+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c09b8e0 con 0x7fe59c0b5e30 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.892+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe590011a80 con 0x7fe59c0b5e30 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.892+0000 7fe59a7fc700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 0x7fe5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.893+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5900861f0 con 0x7fe59c0b5e30 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.893+0000 7fe5a216d700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 0x7fe5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.893+0000 7fe5a216d700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 0x7fe5880693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe58c006fd0 tx=0x7fe58c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:05.897+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe59c09b8e0 con 0x7fe59c0b5e30 2023-10-06T04:17:06.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.146+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe59c0b2f90 con 0x7fe59c0b5e30 2023-10-06T04:17:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.149+0000 7fe59a7fc700 1 -- 172.21.15.37:0/3242075502 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163697 (secure 0 0 0) 0x7fe590053300 con 0x7fe59c0b5e30 2023-10-06T04:17:06.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 msgr2=0x7fe5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 0x7fe5880693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe58c006fd0 tx=0x7fe58c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 msgr2=0x7fe59c152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe590009f80 tx=0x7fe590017000 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 shutdown_connections 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe588066f30 0x7fe5880693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe59c0b6200 0x7fe59c158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe59c0ad0f0 0x7fe59c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 --2- 172.21.15.37:0/3242075502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c0b5e30 0x7fe59c152890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 >> 172.21.15.37:0/3242075502 conn(0x7fe59c099a10 msgr2=0x7fe59c069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 shutdown_connections 2023-10-06T04:17:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.152+0000 7fe5a43d1700 1 -- 172.21.15.37:0/3242075502 wait complete. 2023-10-06T04:17:06.167 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":90301},{"type":"v1","addr":"172.21.15.83:6833","nonce":90301}]},"active_addr":"172.21.15.83:6833/90301","active_change":"2023-10-06T04:16:35.473967+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2609126932}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":504984663}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":828779678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4229477735}]}]} 2023-10-06T04:17:06.173 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:17:06.173 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:17:06.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.289+0000 7f03e0083700 1 Processor -- start 2023-10-06T04:17:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.290+0000 7f03e0083700 1 -- start start 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.290+0000 7f03e0083700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 0x7f03d80ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.290+0000 7f03e0083700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03d80b6200 0x7f03d80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03e0083700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80ae9f0 con 0x7f03d80b5e30 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03e0083700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80adb70 con 0x7f03d80b6200 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03e0083700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80adde0 con 0x7f03d815dc70 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dde1f700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f03d80b5e30 0x7f03d815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55168/0 (socket says 172.21.15.37:55168) 2023-10-06T04:17:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dde1f700 1 -- 172.21.15.37:0/1311582518 learned_addr learned my addr 172.21.15.37:0/1311582518 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 --2- 172.21.15.37:0/1311582518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 0x7f03d80ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03de620700 1 --2- 172.21.15.37:0/1311582518 >> v2:172.21.15.83:3300/0 conn(0x7f03d80b6200 0x7f03d80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dce1d700 1 -- 172.21.15.37:0/1311582518 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076490657 0 0) 0x7f03d80ae9f0 con 0x7f03d80b5e30 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dce1d700 1 -- 172.21.15.37:0/1311582518 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c0003570 con 0x7f03d80b5e30 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 -- 172.21.15.37:0/1311582518 >> v2:172.21.15.83:3300/0 conn(0x7f03d80b6200 msgr2=0x7f03d80ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 --2- 172.21.15.37:0/1311582518 >> v2:172.21.15.83:3300/0 conn(0x7f03d80b6200 0x7f03d80ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 -- 172.21.15.37:0/1311582518 >> v1:172.21.15.37:6789/0 conn(0x7f03d80b5e30 legacy=0x7f03d815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 -- 172.21.15.37:0/1311582518 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80ae0c0 con 0x7f03d815dc70 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dd61e700 1 --2- 172.21.15.37:0/1311582518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 0x7f03d80ad0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0098e0 tx=0x7f03cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aeceecfa6b1e5cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.291+0000 7f03dce1d700 1 -- 172.21.15.37:0/1311582518 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc011630 con 0x7f03d815dc70 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03dce1d700 1 -- 172.21.15.37:0/1311582518 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc011790 con 0x7f03d815dc70 2023-10-06T04:17:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03dce1d700 1 -- 172.21.15.37:0/1311582518 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc011b30 con 0x7f03d815dc70 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 -- 172.21.15.37:0/1311582518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 msgr2=0x7f03d80ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 --2- 172.21.15.37:0/1311582518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 0x7f03d80ad0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0098e0 tx=0x7f03cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 -- 172.21.15.37:0/1311582518 shutdown_connections 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 --2- 172.21.15.37:0/1311582518 >> v2:172.21.15.83:3300/0 conn(0x7f03d80b6200 0x7f03d80ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 --2- 172.21.15.37:0/1311582518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d815dc70 0x7f03d80ad0f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 -- 172.21.15.37:0/1311582518 >> 172.21.15.37:0/1311582518 conn(0x7f03d8099a10 msgr2=0x7f03d806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 -- 172.21.15.37:0/1311582518 shutdown_connections 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.292+0000 7f03e0083700 1 -- 172.21.15.37:0/1311582518 wait complete. 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.293+0000 7f03e0083700 1 Processor -- start 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.293+0000 7f03e0083700 1 -- start start 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d80b6200 0x7f03d815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 0x7f03d815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8152cb0 con 0x7f03d80b5e30 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d809a830 con 0x7f03d815dc70 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03e0083700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d809a550 con 0x7f03d80b6200 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54414/0 (socket says 172.21.15.37:54414) 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 -- 172.21.15.37:0/3264794602 learned_addr learned my addr 172.21.15.37:0/3264794602 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03de620700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 0x7f03d815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dd61e700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d80b6200 0x7f03d815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 -- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d80b6200 msgr2=0x7f03d815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d80b6200 0x7f03d815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 -- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 msgr2=0x7f03d815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 0x7f03d815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03dde1f700 1 -- 172.21.15.37:0/3264794602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc009420 con 0x7f03d80b5e30 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.294+0000 7f03de620700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 0x7f03d815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03dde1f700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c7c0 tx=0x7f03d0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0005b30 con 0x7f03d80b5e30 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0005c90 con 0x7f03d80b5e30 2023-10-06T04:17:06.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d8152660 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0007340 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.295+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d809a170 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.296+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d81524c0 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.296+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03d001b400 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.297+0000 7f03d5ffb700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 0x7f03c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.297+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03d0084230 con 0x7f03d80b5e30 2023-10-06T04:17:06.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.297+0000 7f03dd61e700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 0x7f03c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.297+0000 7f03dd61e700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 0x7f03c40693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03d81549d0 tx=0x7f03cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.301+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03d81524c0 con 0x7f03d80b5e30 2023-10-06T04:17:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.495+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d81524c0 con 0x7f03d80b5e30 2023-10-06T04:17:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.496+0000 7f03d5ffb700 1 -- 172.21.15.37:0/3264794602 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f03d81524c0 con 0x7f03d80b5e30 2023-10-06T04:17:06.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:06.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 msgr2=0x7f03c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 0x7f03c40693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03d81549d0 tx=0x7f03cc017000 comp rx=0 tx=0).stop 2023-10-06T04:17:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 msgr2=0x7f03d8150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c7c0 tx=0x7f03d0007e00 comp rx=0 tx=0).stop 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 shutdown_connections 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03c4066f30 0x7f03c40693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03d815dc70 0x7f03d815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d80b5e30 0x7f03d8150cf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 --2- 172.21.15.37:0/3264794602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03d80b6200 0x7f03d815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 >> 172.21.15.37:0/3264794602 conn(0x7f03d8099a10 msgr2=0x7f03d806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 shutdown_connections 2023-10-06T04:17:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.498+0000 7f03e0083700 1 -- 172.21.15.37:0/3264794602 wait complete. 2023-10-06T04:17:06.513 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:17:06.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.630+0000 7fb5d0578700 1 Processor -- start 2023-10-06T04:17:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.630+0000 7fb5d0578700 1 -- start start 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5d0578700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb5c80c9940 0x7fb5c815b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5d0578700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c806c290 con 0x7fb5c80b2450 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5d0578700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c8157c50 con 0x7fb5c806e7e0 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5d0578700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c815bc60 con 0x7fb5c80c9940 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5ceb15700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb5c80b2450 0x7fb5c806c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58386/0 (socket says 172.21.15.37:58386) 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.631+0000 7fb5ceb15700 1 -- 172.21.15.37:0/1165148783 learned_addr learned my addr 172.21.15.37:0/1165148783 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ce314700 1 --2- 172.21.15.37:0/1165148783 >> v2:172.21.15.83:3300/0 conn(0x7fb5c80c9940 0x7fb5c815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479299399 0 0) 0x7fb5c806c290 con 0x7fb5c80b2450 2023-10-06T04:17:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b0003570 con 0x7fb5c80b2450 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165273975 0 0) 0x7fb5b0003570 con 0x7fb5c80b2450 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 >> v2:172.21.15.83:3300/0 conn(0x7fb5c80c9940 msgr2=0x7fb5c815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 --2- 172.21.15.37:0/1165148783 >> v2:172.21.15.83:3300/0 conn(0x7fb5c80c9940 0x7fb5c815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 >> v1:172.21.15.83:6789/0 conn(0x7fb5c806e7e0 legacy=0x7fb5c80cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c815bf40 con 0x7fb5c80b2450 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fb5b8001470 con 0x7fb5c80b2450 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 >> v1:172.21.15.37:6789/0 conn(0x7fb5c80b2450 legacy=0x7fb5c806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b0003a60 0x7fb5b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5b0004810 0x7fb5b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 0x7fb5b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c815bc60 con 0x7fb5b00051c0 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b000c0d0 con 0x7fb5b0003a60 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b000c290 con 0x7fb5b0004810 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 0x7fb5b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ce314700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b0003a60 0x7fb5b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5cdb13700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5b0004810 0x7fb5b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 -- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5b0004810 msgr2=0x7fb5b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5b0004810 0x7fb5b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 -- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b0003a60 msgr2=0x7fb5b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b0003a60 0x7fb5b0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 -- 172.21.15.37:0/1165148783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0003570 con 0x7fb5b00051c0 2023-10-06T04:17:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.632+0000 7fb5ceb15700 1 -- 172.21.15.37:0/1165148783 reap_dead start 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 0x7fb5b000ba60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c390 tx=0x7fb5c806c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82cd758cf2be6e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800cc60 con 0x7fb5b00051c0 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b800cdc0 con 0x7fb5b00051c0 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5cd312700 1 -- 172.21.15.37:0/1165148783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8005b70 con 0x7fb5b00051c0 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 -- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 msgr2=0x7fb5b000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 0x7fb5b000ba60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c390 tx=0x7fb5c806c200 comp rx=0 tx=0).stop 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 -- 172.21.15.37:0/1165148783 shutdown_connections 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 --2- 172.21.15.37:0/1165148783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b00051c0 0x7fb5b000ba60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 -- 172.21.15.37:0/1165148783 >> 172.21.15.37:0/1165148783 conn(0x7fb5c806a810 msgr2=0x7fb5c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 -- 172.21.15.37:0/1165148783 shutdown_connections 2023-10-06T04:17:06.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.633+0000 7fb5d0578700 1 -- 172.21.15.37:0/1165148783 wait complete. 2023-10-06T04:17:06.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.634+0000 7fb5d0578700 1 Processor -- start 2023-10-06T04:17:06.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.634+0000 7fb5d0578700 1 -- start start 2023-10-06T04:17:06.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 0x7fb5c8147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c80b0240 0x7fb5c80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b0c00 con 0x7fb5c80b06b0 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b0ee0 con 0x7fb5b00051c0 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5d0578700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b11c0 con 0x7fb5c80b0240 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ceb15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ceb15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39778/0 (socket says 172.21.15.37:39778) 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ceb15700 1 -- 172.21.15.37:0/2159061481 learned_addr learned my addr 172.21.15.37:0/2159061481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ce314700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 0x7fb5c8147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5cdb13700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c80b0240 0x7fb5c80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ceb15700 1 -- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c80b0240 msgr2=0x7fb5c80c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.635+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c80b0240 0x7fb5c80c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5ceb15700 1 -- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 msgr2=0x7fb5c8147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 0x7fb5c8147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5ceb15700 1 -- 172.21.15.37:0/2159061481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80b14a0 con 0x7fb5c80b06b0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5ce314700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 0x7fb5c8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5ceb15700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007cd0 tx=0x7fb5b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8020070 con 0x7fb5c80b06b0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b8000ed0 con 0x7fb5c80b06b0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80b1780 con 0x7fb5c80b06b0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800cc60 con 0x7fb5c80b06b0 2023-10-06T04:17:06.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.636+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c8169a10 con 0x7fb5c80b06b0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.637+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8169c00 con 0x7fb5c80b06b0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.637+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5b8025410 con 0x7fb5c80b06b0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.638+0000 7fb5c67fc700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.638+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5b8084c20 con 0x7fb5c80b06b0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.638+0000 7fb5ce314700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.638+0000 7fb5ce314700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 0x7fb5b40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fd0 tx=0x7fb5c000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:06.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.642+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5c8169c00 con 0x7fb5c80b06b0 2023-10-06T04:17:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.839+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c80b19c0 con 0x7fb5c80b06b0 2023-10-06T04:17:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.839+0000 7fb5c67fc700 1 -- 172.21.15.37:0/2159061481 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fb5c80b19c0 con 0x7fb5c80b06b0 2023-10-06T04:17:06.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:06.842 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.841+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 msgr2=0x7fb5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.841+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 0x7fb5b40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009fd0 tx=0x7fb5c000b040 comp rx=0 tx=0).stop 2023-10-06T04:17:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.841+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 msgr2=0x7fb5c80c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.841+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007cd0 tx=0x7fb5b8013000 comp rx=0 tx=0).stop 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 shutdown_connections 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c80b06b0 0x7fb5c80c7970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb5b4066f30 0x7fb5b40693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5b00051c0 0x7fb5c8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 --2- 172.21.15.37:0/2159061481 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5c80b0240 0x7fb5c80c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 >> 172.21.15.37:0/2159061481 conn(0x7fb5c806a810 msgr2=0x7fb5c806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 shutdown_connections 2023-10-06T04:17:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:06.842+0000 7fb5d0578700 1 -- 172.21.15.37:0/2159061481 wait complete. 2023-10-06T04:17:06.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:17:06.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:17:06.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:17:06.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:17:06.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:17:06.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:17:06.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:17:06.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:17:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.058+0000 7fdec2159700 1 Processor -- start 2023-10-06T04:17:07.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.066+0000 7fdec2159700 1 -- start start 2023-10-06T04:17:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.067+0000 7fdec2159700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdebc06ee60 0x7fdebc0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.067+0000 7fdec2159700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc0ac050 con 0x7fdebc0ac7c0 2023-10-06T04:17:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.067+0000 7fdec2159700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc0ac330 con 0x7fdebc0ccd60 2023-10-06T04:17:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.067+0000 7fdec2159700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdebc15c9a0 con 0x7fdebc06ee60 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.067+0000 7fdebaffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdebc06ee60 0x7fdebc0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdebc06ee60 0x7fdebc0aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40128/0 (socket says 172.21.15.37:40128) 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 -- 172.21.15.37:0/1635401362 learned_addr learned my addr 172.21.15.37:0/1635401362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 -- 172.21.15.37:0/1635401362 >> v1:172.21.15.83:6789/0 conn(0x7fdebc0ccd60 legacy=0x7fdebc06e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 -- 172.21.15.37:0/1635401362 >> v1:172.21.15.37:6789/0 conn(0x7fdebc0ac7c0 legacy=0x7fdebc0acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 -- 172.21.15.37:0/1635401362 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc156e20 con 0x7fdebc06ee60 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdebaffd700 1 --2- 172.21.15.37:0/1635401362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc06ee60 0x7fdebc0aa7e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeac013260 tx=0x7fdeac011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3533ca9de1a8258b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.068+0000 7fdeba7fc700 1 -- 172.21.15.37:0/1635401362 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac016070 con 0x7fdebc06ee60 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7fdeba7fc700 1 -- 172.21.15.37:0/1635401362 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac0110d0 con 0x7fdebc06ee60 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7fdeba7fc700 1 -- 172.21.15.37:0/1635401362 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac011470 con 0x7fdebc06ee60 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7f1fd0bf6700 1 Processor -- start 2023-10-06T04:17:07.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7f1fd0bf6700 1 -- start start 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7fdec2159700 1 -- 172.21.15.37:0/1635401362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc06ee60 msgr2=0x7fdebc0aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.069+0000 7fdec2159700 1 --2- 172.21.15.37:0/1635401362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc06ee60 0x7fdebc0aa7e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeac013260 tx=0x7fdeac011af0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7fdec2159700 1 -- 172.21.15.37:0/1635401362 shutdown_connections 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7fdec2159700 1 --2- 172.21.15.37:0/1635401362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc06ee60 0x7fdebc0aa7e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7fdec2159700 1 -- 172.21.15.37:0/1635401362 >> 172.21.15.37:0/1635401362 conn(0x7fdebc0cc250 msgr2=0x7fdebc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7fdec2159700 1 -- 172.21.15.37:0/1635401362 shutdown_connections 2023-10-06T04:17:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7fdec2159700 1 -- 172.21.15.37:0/1635401362 wait complete. 2023-10-06T04:17:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fd0bf6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fc4054470 0x7f1fc4033740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fd0bf6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1fc4033c80 0x7f1fc4005df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fd0bf6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc4053fe0 con 0x7f1fc404fc50 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fd0bf6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc4034070 con 0x7f1fc4054470 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fd0bf6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc40533d0 con 0x7f1fc4033c80 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fcbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1fc4033c80 0x7f1fc4005df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fcbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1fc4033c80 0x7f1fc4005df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40134/0 (socket says 172.21.15.37:40134) 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.070+0000 7f1fcbfff700 1 -- 172.21.15.37:0/856790182 learned_addr learned my addr 172.21.15.37:0/856790182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcaffd700 1 --2- 172.21.15.37:0/856790182 >> v2:172.21.15.37:3300/0 conn(0x7f1fc4054470 0x7f1fc4033740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcbfff700 1 -- 172.21.15.37:0/856790182 >> v2:172.21.15.37:3300/0 conn(0x7f1fc4054470 msgr2=0x7f1fc4033740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/856790182 >> v2:172.21.15.37:3300/0 conn(0x7f1fc4054470 0x7f1fc4033740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcbfff700 1 -- 172.21.15.37:0/856790182 >> v1:172.21.15.83:6789/0 conn(0x7f1fc404fc50 legacy=0x7f1fc4100e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcbfff700 1 -- 172.21.15.37:0/856790182 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40536b0 con 0x7f1fc4033c80 2023-10-06T04:17:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/856790182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4033c80 0x7f1fc4005df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ddb0 tx=0x7f1fb8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d698a0812243d4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fca7fc700 1 -- 172.21.15.37:0/856790182 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800b820 con 0x7f1fc4033c80 2023-10-06T04:17:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fca7fc700 1 -- 172.21.15.37:0/856790182 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800b980 con 0x7f1fc4033c80 2023-10-06T04:17:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.071+0000 7f1fca7fc700 1 -- 172.21.15.37:0/856790182 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800bd20 con 0x7f1fc4033c80 2023-10-06T04:17:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/856790182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4033c80 msgr2=0x7f1fc4005df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/856790182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4033c80 0x7f1fc4005df0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400ddb0 tx=0x7f1fb8009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/856790182 shutdown_connections 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/856790182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4033c80 0x7f1fc4005df0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/856790182 >> v2:172.21.15.37:3300/0 conn(0x7f1fc4054470 0x7f1fc4033740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.072+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/856790182 >> 172.21.15.37:0/856790182 conn(0x7f1fc4051690 msgr2=0x7f1fc4051a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.074+0000 7fa1e9baf700 1 Processor -- start 2023-10-06T04:17:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.074+0000 7fa1e9baf700 1 -- start start 2023-10-06T04:17:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.074+0000 7fdec2159700 1 Processor -- start 2023-10-06T04:17:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.074+0000 7fdec2159700 1 -- start start 2023-10-06T04:17:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdebc06ee60 0x7fdebc1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc0ac7c0 0x7fdebc0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdebc0ccd60 0x7fdebc1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0afc00 con 0x7fdebc06ee60 2023-10-06T04:17:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0aeff0 con 0x7fdebc0ac7c0 2023-10-06T04:17:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdec2159700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0af2d0 con 0x7fdebc0ccd60 2023-10-06T04:17:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7ffaff59e700 1 Processor -- start 2023-10-06T04:17:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdebb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdebc06ee60 0x7fdebc1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdebb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdebc06ee60 0x7fdebc1511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39798/0 (socket says 172.21.15.37:39798) 2023-10-06T04:17:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdebb7fe700 1 -- 172.21.15.37:0/220386763 learned_addr learned my addr 172.21.15.37:0/220386763 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdebaffd700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc0ac7c0 0x7fdebc0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fdebbfff700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdebc0ccd60 0x7fdebc1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fa1e9baf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e40ac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fa1e9baf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e40af4f0 0x7fa1e406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fa1e9baf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e406e910 con 0x7fa1e40b0530 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fa1e9baf700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e406f2f0 con 0x7fa1e40af4f0 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7fa1e9baf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40b0d20 con 0x7fa1e415a790 2023-10-06T04:17:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.075+0000 7ffaff59e700 1 -- start start 2023-10-06T04:17:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/856790182 shutdown_connections 2023-10-06T04:17:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fa1e3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e40af4f0 0x7fa1e406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fa1e3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e40af4f0 0x7fa1e406f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39802/0 (socket says 172.21.15.37:39802) 2023-10-06T04:17:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fa1e3fff700 1 -- 172.21.15.37:0/2773569403 learned_addr learned my addr 172.21.15.37:0/2773569403 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 -- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc0ac7c0 msgr2=0x7fdebc0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc0ac7c0 0x7fdebc0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 -- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdebc06ee60 msgr2=0x7fdebc1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdebc06ee60 0x7fdebc1511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 -- 172.21.15.37:0/220386763 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac011d90 con 0x7fdebc0ccd60 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/856790182 wait complete. 2023-10-06T04:17:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fdebbfff700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdebc0ccd60 0x7fdebc1582b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000b4c0 tx=0x7fdeb0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.076+0000 7fa1e37fe700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e40ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000be70 con 0x7fdebc0ccd60 2023-10-06T04:17:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb000f510 con 0x7fdebc0ccd60 2023-10-06T04:17:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000f8f0 con 0x7fdebc0ccd60 2023-10-06T04:17:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc0af5b0 con 0x7fdebc0ccd60 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc151720 con 0x7fdebc0ccd60 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fa1e3fff700 1 -- 172.21.15.37:0/2773569403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 msgr2=0x7fa1e40ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fa1e3fff700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e40ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fa1e3fff700 1 -- 172.21.15.37:0/2773569403 >> v1:172.21.15.37:6789/0 conn(0x7fa1e40b0530 legacy=0x7fa1e40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fa1e3fff700 1 -- 172.21.15.37:0/2773569403 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e40b1000 con 0x7fa1e40af4f0 2023-10-06T04:17:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7fa1e3fff700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40af4f0 0x7fa1e406f6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009f20 tx=0x7fa1dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83064b32984ee60a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7ffaff59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 0x7ffb0015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7ffaff59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb0006a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7ffaff59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000c8450 con 0x7ffb000af6f0 2023-10-06T04:17:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7ffaff59e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000c7880 con 0x7ffb0015d800 2023-10-06T04:17:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.077+0000 7ffaff59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c7b20 con 0x7ffb0006ecb0 2023-10-06T04:17:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7f1fd0bf6700 1 Processor -- start 2023-10-06T04:17:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7ffafe59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 0x7ffb0015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7ffafe59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 0x7ffb0015dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39816/0 (socket says 172.21.15.37:39816) 2023-10-06T04:17:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7ffafe59c700 1 -- 172.21.15.37:0/3465244361 learned_addr learned my addr 172.21.15.37:0/3465244361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7f1fd0bf6700 1 -- start start 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7f1fd0bf6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fc4033c80 0x7f1fc40f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fd0bf6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc404fc50 0x7f1fc40f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fd0bf6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4054470 0x7f1fc40f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fd0bf6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4035e00 con 0x7f1fc404fc50 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fd0bf6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc40360e0 con 0x7f1fc4054470 2023-10-06T04:17:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fd0bf6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc40363c0 con 0x7f1fc4033c80 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc404fc50 0x7f1fc40f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcb7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fc4033c80 0x7f1fc40f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc404fc50 0x7f1fc40f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39828/0 (socket says 172.21.15.37:39828) 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcaffd700 1 -- 172.21.15.37:0/4177235053 learned_addr learned my addr 172.21.15.37:0/4177235053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4054470 0x7f1fc40f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3465244361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb0006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdeb000fca0 con 0x7fdebc0ccd60 2023-10-06T04:17:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7fa1e27fc700 1 -- 172.21.15.37:0/2773569403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00e070 con 0x7fa1e40af4f0 2023-10-06T04:17:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7fa1e27fc700 1 -- 172.21.15.37:0/2773569403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc00b990 con 0x7fa1e40af4f0 2023-10-06T04:17:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.078+0000 7fa1e27fc700 1 -- 172.21.15.37:0/2773569403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0092e0 con 0x7fa1e40af4f0 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.079+0000 7f1fcbfff700 1 -- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fc4033c80 msgr2=0x7f1fc40f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1fc4033c80 0x7f1fc40f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7f1fcbfff700 1 -- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc404fc50 msgr2=0x7f1fc40f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc404fc50 0x7f1fc40f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7f1fcbfff700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80094f0 con 0x7f1fc4054470 2023-10-06T04:17:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7ffafdd9b700 1 -- 172.21.15.37:0/3465244361 >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 msgr2=0x7ffb0015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3465244361 >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 0x7ffb0015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7ffafdd9b700 1 -- 172.21.15.37:0/3465244361 >> v1:172.21.15.37:6789/0 conn(0x7ffb000af6f0 legacy=0x7ffb000c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7ffafdd9b700 1 -- 172.21.15.37:0/3465244361 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000c7e00 con 0x7ffb0006ecb0 2023-10-06T04:17:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fdea37fe700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdea8067000 0x7fdea80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3465244361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb0006a730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40098e0 tx=0x7ffaf40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8acb88b445f8572 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdeb0083e50 con 0x7fdebc0ccd60 2023-10-06T04:17:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fdebb7fe700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdea8067000 0x7fdea80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7f1fcbfff700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4054470 0x7f1fc40f4da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b490 tx=0x7f1fb8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7ffafd59a700 1 -- 172.21.15.37:0/3465244361 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011630 con 0x7ffb0006ecb0 2023-10-06T04:17:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7ffafd59a700 1 -- 172.21.15.37:0/3465244361 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf4011790 con 0x7ffb0006ecb0 2023-10-06T04:17:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7ffafd59a700 1 -- 172.21.15.37:0/3465244361 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011b30 con 0x7ffb0006ecb0 2023-10-06T04:17:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fdec2159700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fde9c0015f0 0x7fde9c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 --> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde9c006b90 con 0x7fde9c0015f0 2023-10-06T04:17:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fdebb7fe700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdea8067000 0x7fdea80694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0c8500 tx=0x7fdeb4009840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2773569403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40af4f0 msgr2=0x7fa1e406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40af4f0 0x7fa1e406f6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009f20 tx=0x7fa1dc009840 comp rx=0 tx=0).stop 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800b820 con 0x7f1fc4054470 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2773569403 shutdown_connections 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40af4f0 0x7fa1e406f6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2773569403 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e40ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2773569403 >> 172.21.15.37:0/2773569403 conn(0x7fa1e4068770 msgr2=0x7fa1e4068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2773569403 shutdown_connections 2023-10-06T04:17:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2773569403 wait complete. 2023-10-06T04:17:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc40366a0 con 0x7f1fc4054470 2023-10-06T04:17:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc40f19f0 con 0x7f1fc4054470 2023-10-06T04:17:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8020070 con 0x7f1fc4054470 2023-10-06T04:17:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8011ea0 con 0x7f1fc4054470 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7ffaff59e700 1 -- 172.21.15.37:0/3465244361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 msgr2=0x7ffb0006a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3465244361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb0006a730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40098e0 tx=0x7ffaf40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 -- 172.21.15.37:0/3465244361 shutdown_connections 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3465244361 >> v2:172.21.15.37:3300/0 conn(0x7ffb0015d800 0x7ffb0015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3465244361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb0006a730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 -- 172.21.15.37:0/3465244361 >> 172.21.15.37:0/3465244361 conn(0x7ffb000c9e60 msgr2=0x7ffb0006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fac000fd0 con 0x7f1fc4054470 2023-10-06T04:17:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fdebaffd700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fde9c0015f0 0x7fde9c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.080+0000 7fad477ed700 1 Processor -- start 2023-10-06T04:17:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.081+0000 7fad477ed700 1 -- start start 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad477ed700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fad40166420 0x7fad401667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad477ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad400ac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad477ed700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400aa390 con 0x7fad400ae920 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad477ed700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad400a9590 con 0x7fad40166420 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad477ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad400ab830 con 0x7fad400ac520 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad44d88700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad400ae920 0x7fad400a8e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58428/0 (socket says 172.21.15.37:58428) 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad44d88700 1 -- 172.21.15.37:0/2048338938 learned_addr learned my addr 172.21.15.37:0/2048338938 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad45589700 1 --2- 172.21.15.37:0/2048338938 >> v2:172.21.15.83:3300/0 conn(0x7fad40166420 0x7fad401667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.082+0000 7fad45d8a700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad400ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad37fff700 1 -- 172.21.15.37:0/2048338938 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679780804 0 0) 0x7fad400aa390 con 0x7fad400ae920 2023-10-06T04:17:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad37fff700 1 -- 172.21.15.37:0/2048338938 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003570 con 0x7fad400ae920 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad45589700 1 -- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 msgr2=0x7fad400ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad45589700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad400ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad45589700 1 -- 172.21.15.37:0/2048338938 >> v1:172.21.15.37:6789/0 conn(0x7fad400ae920 legacy=0x7fad400a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7fad45589700 1 -- 172.21.15.37:0/2048338938 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400ace90 con 0x7fad40166420 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 -- 172.21.15.37:0/3465244361 shutdown_connections 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7ffaff59e700 1 -- 172.21.15.37:0/3465244361 wait complete. 2023-10-06T04:17:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fa1e9baf700 1 Processor -- start 2023-10-06T04:17:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.083+0000 7f101d175700 1 Processor -- start 2023-10-06T04:17:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fad45589700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40166420 0x7fad401667f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad3c007200 tx=0x7fad3c009ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c43aab48c11f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fb8022030 con 0x7f1fc4054470 2023-10-06T04:17:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fad37fff700 1 -- 172.21.15.37:0/2048338938 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00e070 con 0x7fad40166420 2023-10-06T04:17:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fad37fff700 1 -- 172.21.15.37:0/2048338938 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c007ae0 con 0x7fad40166420 2023-10-06T04:17:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fad37fff700 1 -- 172.21.15.37:0/2048338938 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007e80 con 0x7fad40166420 2023-10-06T04:17:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7f1fb77fe700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1fb0067080 0x7f1fb0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1fb80865b0 con 0x7f1fc4054470 2023-10-06T04:17:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fb77fe700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f1fb006f930 0x7f1fb0071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fb00723f0 con 0x7f1fb006f930 2023-10-06T04:17:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 -- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40166420 msgr2=0x7fad401667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40166420 0x7fad401667f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad3c007200 tx=0x7fad3c009ab0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fb8088b50 con 0x7f1fc4054470 2023-10-06T04:17:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fcaffd700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f1fb006f930 0x7f1fb0071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fcb7fe700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1fb0067080 0x7f1fb0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7ffaff59e700 1 Processor -- start 2023-10-06T04:17:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.084+0000 7fa1e9baf700 1 -- start start 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1e40af4f0 0x7fa1e416dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 0x7fa1e41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4159370 con 0x7fa1e40b0530 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e416f0b0 con 0x7fa1e40af4f0 2023-10-06T04:17:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e9baf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e416e420 con 0x7fa1e415a790 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 -- 172.21.15.37:0/2048338938 shutdown_connections 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad400ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 --2- 172.21.15.37:0/2048338938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40166420 0x7fad401667f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fad477ed700 1 -- 172.21.15.37:0/2048338938 >> 172.21.15.37:0/2048338938 conn(0x7fad400cc250 msgr2=0x7fad400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 0x7fa1e41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 0x7fa1e41559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39834/0 (socket says 172.21.15.37:39834) 2023-10-06T04:17:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e2ffd700 1 -- 172.21.15.37:0/2166655825 learned_addr learned my addr 172.21.15.37:0/2166655825 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e3fff700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fa1e37fe700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1e40af4f0 0x7fa1e416dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fad477ed700 1 -- 172.21.15.37:0/2048338938 shutdown_connections 2023-10-06T04:17:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fad477ed700 1 -- 172.21.15.37:0/2048338938 wait complete. 2023-10-06T04:17:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7f1fcb7fe700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1fb0067080 0x7f1fb0069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4103430 tx=0x7f1fc0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 -- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 msgr2=0x7fa1e4158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1e415a790 0x7fa1e4158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 -- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1e40af4f0 msgr2=0x7fa1e416dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1e40af4f0 0x7fa1e416dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 -- 172.21.15.37:0/2166655825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc009ae0 con 0x7fa1e40b0530 2023-10-06T04:17:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7f1fcaffd700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f1fb006f930 0x7f1fb0071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7fdebaffd700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fde9c0015f0 0x7fde9c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.085+0000 7ffaff59e700 1 -- start start 2023-10-06T04:17:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e2ffd700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 0x7fa1e41559c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400b600 tx=0x7fa1d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7f101d175700 1 -- start start 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400f510 con 0x7fa1e40b0530 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400f670 con 0x7fa1e40b0530 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e416e700 con 0x7fa1e40b0530 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400fa30 con 0x7fa1e40b0530 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.086+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e416ecc0 con 0x7fa1e40b0530 2023-10-06T04:17:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb000c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb000af6f0 0x7ffb0016f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0015d800 0x7ffb001602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c48b0 con 0x7ffb000af6f0 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0016f8e0 con 0x7ffb0015d800 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffaff59e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c45d0 con 0x7ffb0006ecb0 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb000c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb000c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54604/0 (socket says 172.21.15.37:54604) 2023-10-06T04:17:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 -- 172.21.15.37:0/3363535973 learned_addr learned my addr 172.21.15.37:0/3363535973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7fad477ed700 1 Processor -- start 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7f101d175700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 0x7f10180ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101d175700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101d175700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10180accc0 con 0x7f10180aee20 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101d175700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180ac0f0 con 0x7f10181578d0 2023-10-06T04:17:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101d175700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1018157ca0 con 0x7f10180b1e70 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb000af6f0 0x7ffb0016f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 -- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0015d800 msgr2=0x7ffb001602e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb0015d800 0x7ffb001602e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 -- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb000af6f0 msgr2=0x7ffb0016f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb000af6f0 0x7ffb0016f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009420 con 0x7ffb0006ecb0 2023-10-06T04:17:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb000af6f0 0x7ffb0016f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7ffafe59c700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb000c3360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e9b0 tx=0x7ffaf0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f1016d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 0x7f10180ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54608/0 (socket says 172.21.15.37:54608) 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f1016d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 0x7f10180ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39848/0 (socket says 172.21.15.37:39848) 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 -- 172.21.15.37:0/2207155063 learned_addr learned my addr 172.21.15.37:0/2207155063 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 -- 172.21.15.37:0/2207155063 >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 msgr2=0x7f10180ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 --2- 172.21.15.37:0/2207155063 >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 0x7f10180ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 -- 172.21.15.37:0/2207155063 >> v1:172.21.15.83:6789/0 conn(0x7f10180aee20 legacy=0x7f10180b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 -- 172.21.15.37:0/2207155063 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180ac390 con 0x7f10180b1e70 2023-10-06T04:17:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7f101759e700 1 --2- 172.21.15.37:0/2207155063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10080099b0 tx=0x7f1008009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac456bb9526652d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.087+0000 7fad477ed700 1 -- start start 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7fad477ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad40165660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7fad477ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 0x7fad40096a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7fad477ed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad40166420 0x7fad400b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7fad477ed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400b1d20 con 0x7fad40166420 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.088+0000 7fad477ed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40098dc0 con 0x7fad400ae920 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad477ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4016ad80 con 0x7fad400ac520 2023-10-06T04:17:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7f1015d9b700 1 -- 172.21.15.37:0/2207155063 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800b8b0 con 0x7f10180b1e70 2023-10-06T04:17:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 0x7fad40096a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7f1015d9b700 1 -- 172.21.15.37:0/2207155063 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800ba10 con 0x7f10180b1e70 2023-10-06T04:17:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7f1015d9b700 1 -- 172.21.15.37:0/2207155063 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800bdb0 con 0x7f10180b1e70 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad45589700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad40165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 0x7fad40096a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40170/0 (socket says 172.21.15.37:40170) 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 -- 172.21.15.37:0/1505196095 learned_addr learned my addr 172.21.15.37:0/1505196095 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 -- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 msgr2=0x7fad40165660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fad400ac520 0x7fad40165660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 -- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad40166420 msgr2=0x7fad400b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad40166420 0x7fad400b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009d50 con 0x7fad400ae920 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad44d88700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 0x7fad40096a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ccb0 tx=0x7fad38001ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800a980 con 0x7fad400ae920 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800ab00 con 0x7fad400ae920 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40165ba0 con 0x7fad400ae920 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4016a730 con 0x7fad400ae920 2023-10-06T04:17:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1d401a400 con 0x7fa1e40b0530 2023-10-06T04:17:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fa1cb7fe700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa1cc067120 0x7fa1cc0695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1d40842f0 con 0x7fa1e40b0530 2023-10-06T04:17:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000c850 con 0x7ffb0006ecb0 2023-10-06T04:17:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf000c9b0 con 0x7ffb0006ecb0 2023-10-06T04:17:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb000c3ca0 con 0x7ffb0006ecb0 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb000c4260 con 0x7ffb0006ecb0 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.089+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000cd30 con 0x7ffb0006ecb0 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffae4000fd0 con 0x7ffb0006ecb0 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fa1e37fe700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa1cc067120 0x7fa1cc0695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7f101d175700 1 -- 172.21.15.37:0/2207155063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 msgr2=0x7f10180ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7f101d175700 1 --2- 172.21.15.37:0/2207155063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10080099b0 tx=0x7f1008009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7fa1e41538d0 0x7fa1e405e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 --> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1e40cd6a0 con 0x7fa1e41538d0 2023-10-06T04:17:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380070f0 con 0x7fad400ae920 2023-10-06T04:17:07.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.090+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad20000fd0 con 0x7fad400ae920 2023-10-06T04:17:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.091+0000 7fa1e37fe700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa1cc067120 0x7fa1cc0695d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4171310 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.091+0000 7fa1e3fff700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7fa1e41538d0 0x7fa1e405e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.091+0000 7fa1e3fff700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7fa1e41538d0 0x7fa1e405e080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.091+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffaf0013680 con 0x7ffb0006ecb0 2023-10-06T04:17:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== osd.3 v2:172.21.15.37:6821/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fde9c006b90 con 0x7fde9c0015f0 2023-10-06T04:17:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f101d175700 1 -- 172.21.15.37:0/2207155063 shutdown_connections 2023-10-06T04:17:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f101d175700 1 --2- 172.21.15.37:0/2207155063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f10180b1e70 0x7f10180ad150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f101d175700 1 --2- 172.21.15.37:0/2207155063 >> v2:172.21.15.37:3300/0 conn(0x7f10181578d0 0x7f10180ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f101d175700 1 -- 172.21.15.37:0/2207155063 >> 172.21.15.37:0/2207155063 conn(0x7f10180680f0 msgr2=0x7f10180cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad380074e0 con 0x7fad400ae920 2023-10-06T04:17:07.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== osd.4 v2:172.21.15.83:6800/90892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa1e40cd6a0 con 0x7fa1e41538d0 2023-10-06T04:17:07.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f1915d1b700 1 Processor -- start 2023-10-06T04:17:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fad357fa700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fad24066f30 0x7fad240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad38085510 con 0x7fad400ae920 2023-10-06T04:17:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7fad45589700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fad24066f30 0x7fad240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7fad357fa700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7fad2406f7e0 0x7fad24071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== osd.1 v2:172.21.15.37:6800/90646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1fb00723f0 con 0x7f1fb006f930 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad240722a0 con 0x7fad2406f7e0 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad380858e0 con 0x7fad400ae920 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffaee7fc700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ffae0066f30 0x7ffae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffaf00848e0 con 0x7ffb0006ecb0 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ffae0066f30 0x7ffae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffaee7fc700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7ffae006f7e0 0x7ffae0071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffae00722a0 con 0x7ffae006f7e0 2023-10-06T04:17:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaf0089220 con 0x7ffb0006ecb0 2023-10-06T04:17:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7fad45589700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fad24066f30 0x7fad240693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009af0 tx=0x7fad3c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7fc207cc5700 1 Processor -- start 2023-10-06T04:17:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f101d175700 1 -- 172.21.15.37:0/2207155063 shutdown_connections 2023-10-06T04:17:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7ffafdd9b700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ffae0066f30 0x7ffae00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40030c0 tx=0x7ffaf4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.092+0000 7f1915d1b700 1 -- start start 2023-10-06T04:17:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f1915d1b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f19100c6660 0x7f19100b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f1915d1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f1915d1b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100adb50 con 0x7f19100b2a50 2023-10-06T04:17:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f1915d1b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19100ade30 con 0x7f19100c6660 2023-10-06T04:17:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f1915d1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100ae110 con 0x7f19100ad300 2023-10-06T04:17:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7ffafed9d700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7ffae006f7e0 0x7ffae0071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54614/0 (socket says 172.21.15.37:54614) 2023-10-06T04:17:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 -- 172.21.15.37:0/1772505279 learned_addr learned my addr 172.21.15.37:0/1772505279 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190effd700 1 --2- 172.21.15.37:0/1772505279 >> v2:172.21.15.83:3300/0 conn(0x7f19100c6660 0x7f19100b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7ffafed9d700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7ffae006f7e0 0x7ffae0071bf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 -- 172.21.15.37:0/1772505279 >> v2:172.21.15.83:3300/0 conn(0x7f19100c6660 msgr2=0x7f19100b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 --2- 172.21.15.37:0/1772505279 >> v2:172.21.15.83:3300/0 conn(0x7f19100c6660 0x7f19100b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 -- 172.21.15.37:0/1772505279 >> v1:172.21.15.83:6789/0 conn(0x7f19100b2a50 legacy=0x7f19100aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7f190ffff700 1 -- 172.21.15.37:0/1772505279 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19100ae3f0 con 0x7f19100ad300 2023-10-06T04:17:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7f190ffff700 1 --2- 172.21.15.37:0/1772505279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1908009f20 tx=0x7f1908009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eead785842bd9865 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.094+0000 7fc207cc5700 1 -- start start 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc207cc5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc200150e60 0x7fc2000aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc207cc5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2000b0170 0x7fc2000af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc207cc5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc200157a10 con 0x7fc200150a90 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc207cc5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc200156ba0 con 0x7fc2000b0170 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc207cc5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20006efd0 con 0x7fc200150e60 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc205260700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc200150e60 0x7fc2000aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc205260700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc200150e60 0x7fc2000aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40180/0 (socket says 172.21.15.37:40180) 2023-10-06T04:17:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7fc205260700 1 -- 172.21.15.37:0/1633727832 learned_addr learned my addr 172.21.15.37:0/1633727832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.093+0000 7f101d175700 1 -- 172.21.15.37:0/2207155063 wait complete. 2023-10-06T04:17:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7f101d175700 1 Processor -- start 2023-10-06T04:17:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7f190e7fc700 1 -- 172.21.15.37:0/1772505279 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800e070 con 0x7f19100ad300 2023-10-06T04:17:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7f190e7fc700 1 -- 172.21.15.37:0/1772505279 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800ba80 con 0x7f19100ad300 2023-10-06T04:17:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.095+0000 7f190e7fc700 1 -- 172.21.15.37:0/1772505279 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080092e0 con 0x7f19100ad300 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc205260700 1 -- 172.21.15.37:0/1633727832 >> v2:172.21.15.37:3300/0 conn(0x7fc2000b0170 msgr2=0x7fc2000af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc205260700 1 --2- 172.21.15.37:0/1633727832 >> v2:172.21.15.37:3300/0 conn(0x7fc2000b0170 0x7fc2000af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc205260700 1 -- 172.21.15.37:0/1633727832 >> v1:172.21.15.37:6789/0 conn(0x7fc200150a90 legacy=0x7fc20006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc205260700 1 -- 172.21.15.37:0/1633727832 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200156e00 con 0x7fc200150e60 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc205260700 1 --2- 172.21.15.37:0/1633727832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc200150e60 0x7fc2000aede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc20006eac0 tx=0x7fc1fc00b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172fce94aa884f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc204a5f700 1 -- 172.21.15.37:0/1633727832 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00dc10 con 0x7fc200150e60 2023-10-06T04:17:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc204a5f700 1 -- 172.21.15.37:0/1633727832 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00dd70 con 0x7fc200150e60 2023-10-06T04:17:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7fc204a5f700 1 -- 172.21.15.37:0/1633727832 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0106c0 con 0x7fc200150e60 2023-10-06T04:17:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7fad45d8a700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7fad2406f7e0 0x7fad24071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 -- 172.21.15.37:0/1772505279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 msgr2=0x7f19100cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 --2- 172.21.15.37:0/1772505279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1908009f20 tx=0x7f1908009840 comp rx=0 tx=0).stop 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== osd.2 v2:172.21.15.37:6816/90657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffae00722a0 con 0x7ffae006f7e0 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 -- 172.21.15.37:0/1772505279 shutdown_connections 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 --2- 172.21.15.37:0/1772505279 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100ad300 0x7f19100cefc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 --2- 172.21.15.37:0/1772505279 >> v2:172.21.15.83:3300/0 conn(0x7f19100c6660 0x7f19100b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f1915d1b700 1 -- 172.21.15.37:0/1772505279 >> 172.21.15.37:0/1772505279 conn(0x7f1910099c00 msgr2=0x7f191006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7fad45d8a700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7fad2406f7e0 0x7fad24071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 -- 172.21.15.37:0/1633727832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc200150e60 msgr2=0x7fc2000aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 --2- 172.21.15.37:0/1633727832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc200150e60 0x7fc2000aede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc20006eac0 tx=0x7fc1fc00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.096+0000 7f101d175700 1 -- start start 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10180b1e70 0x7f1018175f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 0x7f1018069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101806a1c0 0x7f10180a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101806a620 con 0x7f10181578d0 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10180a5f40 con 0x7f10180b1e70 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.097+0000 7f101d175700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180aad20 con 0x7f101806a1c0 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 0x7f1018069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 0x7f1018069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39870/0 (socket says 172.21.15.37:39870) 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 -- 172.21.15.37:0/3142377930 learned_addr learned my addr 172.21.15.37:0/3142377930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 -- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101806a1c0 msgr2=0x7f10180a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101806a1c0 0x7f10180a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 -- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10180b1e70 msgr2=0x7f1018175f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f1016d9d700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10180b1e70 0x7f1018175f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10180b1e70 0x7f1018175f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f101659c700 1 -- 172.21.15.37:0/3142377930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080094f0 con 0x7f10181578d0 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f1016d9d700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10180b1e70 0x7f1018175f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 -- 172.21.15.37:0/1633727832 shutdown_connections 2023-10-06T04:17:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 --2- 172.21.15.37:0/1633727832 >> v2:172.21.15.37:3300/0 conn(0x7fc2000b0170 0x7fc2000af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 --2- 172.21.15.37:0/1633727832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc200150e60 0x7fc2000aede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fc207cc5700 1 -- 172.21.15.37:0/1633727832 >> 172.21.15.37:0/1633727832 conn(0x7fc200068770 msgr2=0x7fc200068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f1915d1b700 1 -- 172.21.15.37:0/1772505279 shutdown_connections 2023-10-06T04:17:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== osd.0 v2:172.21.15.37:6808/90645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fad240722a0 con 0x7fad2406f7e0 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7fc207cc5700 1 -- 172.21.15.37:0/1633727832 shutdown_connections 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7fc207cc5700 1 -- 172.21.15.37:0/1633727832 wait complete. 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.100+0000 7fc207cc5700 1 Processor -- start 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.098+0000 7f1915d1b700 1 -- 172.21.15.37:0/1772505279 wait complete. 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.100+0000 7f1915d1b700 1 Processor -- start 2023-10-06T04:17:07.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.100+0000 7fc207cc5700 1 -- start start 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f101659c700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 0x7f1018069c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1010003260 tx=0x7f1010002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000cea0 con 0x7f10181578d0 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1010006ba0 con 0x7f10181578d0 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000a7e0 con 0x7f10181578d0 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10180ab000 con 0x7f10181578d0 2023-10-06T04:17:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.099+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10180a5bd0 con 0x7f10181578d0 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2000b0170 0x7fc200176c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc200150a90 0x7fc20017aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 0x7fc20017b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000ccd50 con 0x7fc200150a90 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000cc420 con 0x7fc2000b0170 2023-10-06T04:17:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7fc207cc5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000cc700 con 0x7fc200150e60 2023-10-06T04:17:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f101000abd0 con 0x7f10181578d0 2023-10-06T04:17:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 0x7fc20017b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 0x7fc20017b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54638/0 (socket says 172.21.15.37:54638) 2023-10-06T04:17:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 -- 172.21.15.37:0/738135633 learned_addr learned my addr 172.21.15.37:0/738135633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1006ffd700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0ffc066f80 0x7f0ffc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.101+0000 7f1915d1b700 1 -- start start 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 0x7f19100cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100b2a50 0x7f1910155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19100c6660 0x7f191015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910155d90 con 0x7f19100ad300 2023-10-06T04:17:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191015b8f0 con 0x7f19100c6660 2023-10-06T04:17:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1915d1b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191015bbd0 con 0x7f19100b2a50 2023-10-06T04:17:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1010084640 con 0x7f10181578d0 2023-10-06T04:17:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 0x7f19100cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 0x7f19100cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39884/0 (socket says 172.21.15.37:39884) 2023-10-06T04:17:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f190f7fe700 1 -- 172.21.15.37:0/4123129135 learned_addr learned my addr 172.21.15.37:0/4123129135 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f190effd700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100b2a50 0x7f1910155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7f190ffff700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19100c6660 0x7f191015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 -- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2000b0170 msgr2=0x7fc200176c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:17:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2000b0170 0x7fc200176c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 -- 172.21.15.37:0/738135633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc200150a90 msgr2=0x7fc20017aaf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:17:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc200150a90 0x7fc20017aaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.102+0000 7fc206262700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc00b790 con 0x7fc200150e60 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 -- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100b2a50 msgr2=0x7f1910155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19100b2a50 0x7f1910155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 -- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19100c6660 msgr2=0x7f191015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19100c6660 0x7f191015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908009ae0 con 0x7f19100ad300 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f190f7fe700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 0x7f19100cd420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f190000c590 tx=0x7f190000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011590 con 0x7f19100ad300 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011710 con 0x7f19100ad300 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011ad0 con 0x7f19100ad300 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191015beb0 con 0x7f19100ad300 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191015b550 con 0x7f19100ad300 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f101d175700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f10180aee20 0x7f10180b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.103+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 --> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10180ac670 con 0x7f10180aee20 2023-10-06T04:17:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.104+0000 7fc206262700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 0x7fc20017b030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800bb30 tx=0x7fc1f80097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.104+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19100b3670 con 0x7f19100ad300 2023-10-06T04:17:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.104+0000 7f101759e700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f10180aee20 0x7f10180b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.104+0000 7f101759e700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f10180aee20 0x7f10180b1540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.105+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800c940 con 0x7fc200150e60 2023-10-06T04:17:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.105+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800cae0 con 0x7fc200150e60 2023-10-06T04:17:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.105+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800cea0 con 0x7fc200150e60 2023-10-06T04:17:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.106+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2000cc9e0 con 0x7fc200150e60 2023-10-06T04:17:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.106+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20017b880 con 0x7fc200150e60 2023-10-06T04:17:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.107+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2000cc590 con 0x7fc200150e60 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.107+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f190001b3b0 con 0x7f19100ad300 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.107+0000 7f18f77fe700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f18fc066fb0 0x7f18fc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.107+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1900084270 con 0x7f19100ad300 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f190effd700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f18fc066fb0 0x7f18fc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f18f77fe700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f18fc06f860 0x7f18fc071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18fc072320 con 0x7f18fc06f860 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19000845a0 con 0x7f19100ad300 2023-10-06T04:17:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f190ffff700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f18fc06f860 0x7f18fc071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f190effd700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f18fc066fb0 0x7f18fc069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1910169d00 tx=0x7f1904008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.108+0000 7f190ffff700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f18fc06f860 0x7f18fc071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.109+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1f8014620 con 0x7fc200150e60 2023-10-06T04:17:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.109+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== osd.7 v2:172.21.15.83:6820/90922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f10180ac670 con 0x7f10180aee20 2023-10-06T04:17:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.109+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== osd.5 v2:172.21.15.83:6808/90893 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f18fc072320 con 0x7f18fc06f860 2023-10-06T04:17:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.109+0000 7f1016d9d700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0ffc066f80 0x7f0ffc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc1f5ffb700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1ec0670a0 0x7fc1ec069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1f8085280 con 0x7fc200150e60 2023-10-06T04:17:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7f1016d9d700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0ffc066f80 0x7f0ffc069430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f100c009990 tx=0x7f100c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc1f5ffb700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7fc1ec06f950 0x7fc1ec071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1ec072410 con 0x7fc1ec06f950 2023-10-06T04:17:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1f8085650 con 0x7fc200150e60 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.110+0000 7fc205a61700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1ec0670a0 0x7fc1ec069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.111+0000 7fc205260700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7fc1ec06f950 0x7fc1ec071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.111+0000 7fc205a61700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1ec0670a0 0x7fc1ec069550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009740 tx=0x7fc1f0006c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.111+0000 7fc205260700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7fc1ec06f950 0x7fc1ec071d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.112+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== osd.6 v2:172.21.15.83:6816/90923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc1ec072410 con 0x7fc1ec06f950 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.118+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 --> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1e406a180 con 0x7fa1e41538d0 2023-10-06T04:17:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.118+0000 7fa1cb7fe700 1 -- 172.21.15.37:0/2166655825 <== osd.4 v2:172.21.15.83:6800/90892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1e406a180 con 0x7fa1e41538d0 2023-10-06T04:17:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.119+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 --> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde9c005c20 con 0x7fde9c0015f0 2023-10-06T04:17:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.119+0000 7fdea37fe700 1 -- 172.21.15.37:0/220386763 <== osd.3 v2:172.21.15.37:6821/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde9c005c20 con 0x7fde9c0015f0 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.119+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fde9c0015f0 msgr2=0x7fde9c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.119+0000 7fdec2159700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fde9c0015f0 0x7fde9c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.121+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdea8067000 msgr2=0x7fdea80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.121+0000 7fdec2159700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdea8067000 0x7fdea80694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0c8500 tx=0x7fdeb4009840 comp rx=0 tx=0).stop 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.121+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdebc0ccd60 msgr2=0x7fdebc1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.121+0000 7fdec2159700 1 --2- 172.21.15.37:0/220386763 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdebc0ccd60 0x7fdebc1582b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000b4c0 tx=0x7fdeb0009060 comp rx=0 tx=0).stop 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fdebbfff700 1 -- 172.21.15.37:0/220386763 reap_dead start 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 shutdown_connections 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 >> 172.21.15.37:0/220386763 conn(0x7fdebc0cc250 msgr2=0x7fdebc06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7fa1e41538d0 msgr2=0x7fa1e405e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7fa1e41538d0 0x7fa1e405e080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa1cc067120 msgr2=0x7fa1cc0695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa1cc067120 0x7fa1cc0695d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4171310 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 msgr2=0x7fa1e41559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 --2- 172.21.15.37:0/2166655825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e40b0530 0x7fa1e41559c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400b600 tx=0x7fa1d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e3fff700 1 -- 172.21.15.37:0/2166655825 reap_dead start 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 shutdown_connections 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fdec2159700 1 -- 172.21.15.37:0/220386763 wait complete. 2023-10-06T04:17:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 shutdown_connections 2023-10-06T04:17:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 >> 172.21.15.37:0/2166655825 conn(0x7fa1e4068770 msgr2=0x7fa1e40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 shutdown_connections 2023-10-06T04:17:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.123+0000 7fa1e9baf700 1 -- 172.21.15.37:0/2166655825 wait complete. 2023-10-06T04:17:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.130+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 --> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fac002d30 con 0x7f1fb006f930 2023-10-06T04:17:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.130+0000 7f1fb77fe700 1 -- 172.21.15.37:0/4177235053 <== osd.1 v2:172.21.15.37:6800/90646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fac002d30 con 0x7f1fb006f930 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f1fb006f930 msgr2=0x7f1fb0071d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f1fb006f930 0x7f1fb0071d40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1fb0067080 msgr2=0x7f1fb0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1fb0067080 0x7f1fb0069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4103430 tx=0x7f1fc0009060 comp rx=0 tx=0).stop 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4054470 msgr2=0x7f1fc40f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fd0bf6700 1 --2- 172.21.15.37:0/4177235053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1fc4054470 0x7f1fc40f4da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400b490 tx=0x7f1fb8016000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7f1fcbfff700 1 -- 172.21.15.37:0/4177235053 reap_dead start 2023-10-06T04:17:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.130+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 --> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffae4002d30 con 0x7ffae006f7e0 2023-10-06T04:17:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.131+0000 7ffaee7fc700 1 -- 172.21.15.37:0/3363535973 <== osd.2 v2:172.21.15.37:6816/90657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffae4002d30 con 0x7ffae006f7e0 2023-10-06T04:17:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 --> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad20002d30 con 0x7fad2406f7e0 2023-10-06T04:17:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 shutdown_connections 2023-10-06T04:17:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 >> 172.21.15.37:0/4177235053 conn(0x7f1fc4051690 msgr2=0x7f1fc40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7fad357fa700 1 -- 172.21.15.37:0/1505196095 <== osd.0 v2:172.21.15.37:6808/90645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad20002d30 con 0x7fad2406f7e0 2023-10-06T04:17:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 shutdown_connections 2023-10-06T04:17:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.132+0000 7f1fd0bf6700 1 -- 172.21.15.37:0/4177235053 wait complete. 2023-10-06T04:17:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7ffae006f7e0 msgr2=0x7ffae0071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7ffae006f7e0 0x7ffae0071bf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7fad2406f7e0 msgr2=0x7fad24071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7fad2406f7e0 0x7fad24071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fad24066f30 msgr2=0x7fad240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fad24066f30 0x7fad240693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009af0 tx=0x7fad3c016000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 msgr2=0x7fad40096a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 --2- 172.21.15.37:0/1505196095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad400ae920 0x7fad40096a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ccb0 tx=0x7fad38001ae0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad45d8a700 1 -- 172.21.15.37:0/1505196095 reap_dead start 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ffae0066f30 msgr2=0x7ffae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ffae0066f30 0x7ffae00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40030c0 tx=0x7ffaf4016000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 msgr2=0x7ffb000c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 --2- 172.21.15.37:0/3363535973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb0006ecb0 0x7ffb000c3360 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e9b0 tx=0x7ffaf0009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffafed9d700 1 -- 172.21.15.37:0/3363535973 reap_dead start 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 shutdown_connections 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 >> 172.21.15.37:0/3363535973 conn(0x7ffb000c9e60 msgr2=0x7ffb0006dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 shutdown_connections 2023-10-06T04:17:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 >> 172.21.15.37:0/1505196095 conn(0x7fad400cc250 msgr2=0x7fad40069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 shutdown_connections 2023-10-06T04:17:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.133+0000 7ffaff59e700 1 -- 172.21.15.37:0/3363535973 wait complete. 2023-10-06T04:17:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.134+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 shutdown_connections 2023-10-06T04:17:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.134+0000 7fad477ed700 1 -- 172.21.15.37:0/1505196095 wait complete. 2023-10-06T04:17:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.136+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 --> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10180abd30 con 0x7f10180aee20 2023-10-06T04:17:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.137+0000 7f1006ffd700 1 -- 172.21.15.37:0/3142377930 <== osd.7 v2:172.21.15.83:6820/90922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10180abd30 con 0x7f10180aee20 2023-10-06T04:17:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.139+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 --> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2000cc840 con 0x7fc1ec06f950 2023-10-06T04:17:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.140+0000 7fc1f5ffb700 1 -- 172.21.15.37:0/738135633 <== osd.6 v2:172.21.15.83:6816/90923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2000cc840 con 0x7fc1ec06f950 2023-10-06T04:17:07.175 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T04:17:07.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:17:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f10180aee20 msgr2=0x7f10180b1540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f10180aee20 0x7f10180b1540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0ffc066f80 msgr2=0x7f0ffc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0ffc066f80 0x7f0ffc069430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f100c009990 tx=0x7f100c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 msgr2=0x7f1018069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 --2- 172.21.15.37:0/3142377930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181578d0 0x7f1018069c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1010003260 tx=0x7f1010002720 comp rx=0 tx=0).stop 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101759e700 1 -- 172.21.15.37:0/3142377930 reap_dead start 2023-10-06T04:17:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 --> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1910063410 con 0x7f18fc06f860 2023-10-06T04:17:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 shutdown_connections 2023-10-06T04:17:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 >> 172.21.15.37:0/3142377930 conn(0x7f10180680f0 msgr2=0x7f101806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 shutdown_connections 2023-10-06T04:17:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f101d175700 1 -- 172.21.15.37:0/3142377930 wait complete. 2023-10-06T04:17:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.144+0000 7f18f77fe700 1 -- 172.21.15.37:0/4123129135 <== osd.5 v2:172.21.15.83:6808/90893 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1910063410 con 0x7f18fc06f860 2023-10-06T04:17:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7fc1ec06f950 msgr2=0x7fc1ec071d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7fc1ec06f950 0x7fc1ec071d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1ec0670a0 msgr2=0x7fc1ec069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1ec0670a0 0x7fc1ec069550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009740 tx=0x7fc1f0006c60 comp rx=0 tx=0).stop 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 msgr2=0x7fc20017b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 --2- 172.21.15.37:0/738135633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc200150e60 0x7fc20017b030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800bb30 tx=0x7fc1f80097e0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc206262700 1 -- 172.21.15.37:0/738135633 reap_dead start 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 shutdown_connections 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 >> 172.21.15.37:0/738135633 conn(0x7fc200068770 msgr2=0x7fc200154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 shutdown_connections 2023-10-06T04:17:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.145+0000 7fc207cc5700 1 -- 172.21.15.37:0/738135633 wait complete. 2023-10-06T04:17:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f18fc06f860 msgr2=0x7f18fc071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f18fc06f860 0x7f18fc071c70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f18fc066fb0 msgr2=0x7f18fc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f18fc066fb0 0x7f18fc069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1910169d00 tx=0x7f1904008040 comp rx=0 tx=0).stop 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 msgr2=0x7f19100cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 --2- 172.21.15.37:0/4123129135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19100ad300 0x7f19100cd420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f190000c590 tx=0x7f190000c8a0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f190ffff700 1 -- 172.21.15.37:0/4123129135 reap_dead start 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 shutdown_connections 2023-10-06T04:17:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.151+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 >> 172.21.15.37:0/4123129135 conn(0x7f1910099c00 msgr2=0x7f19100aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.152+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 shutdown_connections 2023-10-06T04:17:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.152+0000 7f1915d1b700 1 -- 172.21.15.37:0/4123129135 wait complete. 2023-10-06T04:17:07.183 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:17:07.186 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:17:07.187 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T04:17:07.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:17:07.188 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:17:07.189 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-10-06T04:17:07.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:17:07.190 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:17:07.191 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:17:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.418+0000 7fe31881f700 1 Processor -- start 2023-10-06T04:17:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.419+0000 7fe31881f700 1 -- start start 2023-10-06T04:17:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.420+0000 7fe31881f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3140ae820 0x7fe31406e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.420+0000 7fe31881f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31406f0f0 con 0x7fe3140b1db0 2023-10-06T04:17:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.420+0000 7fe31881f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140a9f00 con 0x7fe31406ec90 2023-10-06T04:17:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.420+0000 7fe31881f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140aa290 con 0x7fe3140ae820 2023-10-06T04:17:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3140ae820 0x7fe31406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3140ae820 0x7fe31406e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40210/0 (socket says 172.21.15.37:40210) 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 -- 172.21.15.37:0/2541038510 learned_addr learned my addr 172.21.15.37:0/2541038510 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 -- 172.21.15.37:0/2541038510 >> v1:172.21.15.83:6789/0 conn(0x7fe31406ec90 legacy=0x7fe3140aa720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 -- 172.21.15.37:0/2541038510 >> v1:172.21.15.37:6789/0 conn(0x7fe3140b1db0 legacy=0x7fe3140a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 -- 172.21.15.37:0/2541038510 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140b2180 con 0x7fe3140ae820 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe311d9b700 1 --2- 172.21.15.37:0/2541038510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140ae820 0x7fe31406e750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3040099b0 tx=0x7fe304009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0344f3b93ad8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe31159a700 1 -- 172.21.15.37:0/2541038510 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400b7e0 con 0x7fe3140ae820 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe31159a700 1 -- 172.21.15.37:0/2541038510 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400b940 con 0x7fe3140ae820 2023-10-06T04:17:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.421+0000 7fe31159a700 1 -- 172.21.15.37:0/2541038510 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400bce0 con 0x7fe3140ae820 2023-10-06T04:17:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.422+0000 7fe31881f700 1 -- 172.21.15.37:0/2541038510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140ae820 msgr2=0x7fe31406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.422+0000 7fe31881f700 1 --2- 172.21.15.37:0/2541038510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140ae820 0x7fe31406e750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3040099b0 tx=0x7fe304009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.423+0000 7fe31881f700 1 -- 172.21.15.37:0/2541038510 shutdown_connections 2023-10-06T04:17:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.423+0000 7fe31881f700 1 --2- 172.21.15.37:0/2541038510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3140ae820 0x7fe31406e750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.423+0000 7fe31881f700 1 -- 172.21.15.37:0/2541038510 >> 172.21.15.37:0/2541038510 conn(0x7fe3140cc250 msgr2=0x7fe3140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.423+0000 7fe31881f700 1 -- 172.21.15.37:0/2541038510 shutdown_connections 2023-10-06T04:17:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.423+0000 7fe31881f700 1 -- 172.21.15.37:0/2541038510 wait complete. 2023-10-06T04:17:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.424+0000 7fe31881f700 1 Processor -- start 2023-10-06T04:17:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.425+0000 7f761c417700 1 Processor -- start 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.425+0000 7fe31881f700 1 -- start start 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe31406ec90 0x7fe31414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3140ae820 0x7fe314171ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314157f20 con 0x7fe3140ae820 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314096db0 con 0x7fe31406ec90 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe31881f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe314158e50 con 0x7fe3140b1db0 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe312d9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54658/0 (socket says 172.21.15.37:54658) 2023-10-06T04:17:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe312d9d700 1 -- 172.21.15.37:0/2128743196 learned_addr learned my addr 172.21.15.37:0/2128743196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7fe311d9b700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3140ae820 0x7fe314171ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 -- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe31406ec90 msgr2=0x7fe31414c3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe31406ec90 0x7fe31414c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 -- 172.21.15.37:0/2128743196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3140ae820 msgr2=0x7fe314171ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3140ae820 0x7fe314171ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 -- 172.21.15.37:0/2128743196 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040094f0 con 0x7fe3140b1db0 2023-10-06T04:17:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.426+0000 7f761c417700 1 -- start start 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7f761c417700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 0x7f76140aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7f761c417700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76141559a0 0x7f7614155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7f761c417700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76140ac050 con 0x7f76140ac7c0 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7f761c417700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76140ac330 con 0x7f76141559a0 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7f761c417700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7614156b40 con 0x7f76140ccd60 2023-10-06T04:17:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fcfb6554700 1 Processor -- start 2023-10-06T04:17:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.427+0000 7fe312d9d700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00bc60 tx=0x7fe30c009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a1b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 0x7f76140aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a1b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 0x7f76140aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54660/0 (socket says 172.21.15.37:54660) 2023-10-06T04:17:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a1b3700 1 -- 172.21.15.37:0/3332347084 learned_addr learned my addr 172.21.15.37:0/3332347084 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a9b4700 1 --2- 172.21.15.37:0/3332347084 >> v2:172.21.15.37:3300/0 conn(0x7f76141559a0 0x7f7614155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00c8f0 con 0x7fe3140b1db0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00ca50 con 0x7fe3140b1db0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31415f990 con 0x7fe3140b1db0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314158ae0 con 0x7fe3140b1db0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00ce10 con 0x7fe3140b1db0 2023-10-06T04:17:07.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a9b4700 1 -- 172.21.15.37:0/3332347084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 msgr2=0x7f76140aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a9b4700 1 --2- 172.21.15.37:0/3332347084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 0x7f76140aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a9b4700 1 -- 172.21.15.37:0/3332347084 >> v1:172.21.15.83:6789/0 conn(0x7f76140ac7c0 legacy=0x7f76140acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fab1ac89700 1 Processor -- start 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7f761a9b4700 1 -- 172.21.15.37:0/3332347084 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614156e20 con 0x7f76141559a0 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7f761a9b4700 1 --2- 172.21.15.37:0/3332347084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76141559a0 0x7f7614155e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f760c00af70 tx=0x7f760c00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faea92e890ff4438 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7f76191b1700 1 -- 172.21.15.37:0/3332347084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00f070 con 0x7f76141559a0 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7f76191b1700 1 -- 172.21.15.37:0/3332347084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00a2e0 con 0x7f76141559a0 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7f76191b1700 1 -- 172.21.15.37:0/3332347084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00cc30 con 0x7f76141559a0 2023-10-06T04:17:07.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fab1ac89700 1 -- start start 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 -- 172.21.15.37:0/3332347084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76141559a0 msgr2=0x7f7614155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 --2- 172.21.15.37:0/3332347084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76141559a0 0x7f7614155e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f760c00af70 tx=0x7f760c00a890 comp rx=0 tx=0).stop 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe314063410 con 0x7fe3140b1db0 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.428+0000 7fcfb6554700 1 -- start start 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fcfb6554700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcfb006ee60 0x7fcfb00aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fcfb6554700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfb0155d70 0x7fcfb01561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fcfb6554700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00ac050 con 0x7fcfb01559a0 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fcfb6554700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00ac330 con 0x7fcfb0155d70 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.429+0000 7fcfb6554700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb0156b40 con 0x7fcfb006ee60 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfaffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcfb01559a0 0x7fcfb006e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58470/0 (socket says 172.21.15.37:58470) 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfaffff700 1 -- 172.21.15.37:0/2885589408 learned_addr learned my addr 172.21.15.37:0/2885589408 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfb4af1700 1 --2- 172.21.15.37:0/2885589408 >> v2:172.21.15.37:3300/0 conn(0x7fcfb0155d70 0x7fcfb01561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fab1ac89700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab140aa7e0 0x7fab140aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fab1ac89700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab140ac050 con 0x7fab1406e750 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fab1ac89700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab140ac330 con 0x7fab140ccd60 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fab1ac89700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab140ad410 con 0x7fab140aa7e0 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 -- 172.21.15.37:0/3332347084 shutdown_connections 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 --2- 172.21.15.37:0/3332347084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76141559a0 0x7f7614155e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 --2- 172.21.15.37:0/3332347084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ccd60 0x7f76140aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7f761c417700 1 -- 172.21.15.37:0/3332347084 >> 172.21.15.37:0/3332347084 conn(0x7f76140cc250 msgr2=0x7f76140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfb4af1700 1 -- 172.21.15.37:0/2885589408 >> v2:172.21.15.83:3300/0 conn(0x7fcfb006ee60 msgr2=0x7fcfb00aa7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfb4af1700 1 --2- 172.21.15.37:0/2885589408 >> v2:172.21.15.83:3300/0 conn(0x7fcfb006ee60 0x7fcfb00aa7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfb4af1700 1 -- 172.21.15.37:0/2885589408 >> v1:172.21.15.37:6789/0 conn(0x7fcfb01559a0 legacy=0x7fcfb006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.430+0000 7fcfb4af1700 1 -- 172.21.15.37:0/2885589408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0156e20 con 0x7fcfb0155d70 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fcfb4af1700 1 --2- 172.21.15.37:0/2885589408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb01561b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0070e20 tx=0x7fcfa8007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354267a6603ce38f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab19226700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab1406e750 0x7fab141559a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58482/0 (socket says 172.21.15.37:58482) 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab19226700 1 -- 172.21.15.37:0/3190014085 learned_addr learned my addr 172.21.15.37:0/3190014085 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab13fff700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab140aa7e0 0x7fab140aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fcfaeffd700 1 -- 172.21.15.37:0/2885589408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800f070 con 0x7fcfb0155d70 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fcfaeffd700 1 -- 172.21.15.37:0/2885589408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa800a2e0 con 0x7fcfb0155d70 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669279204 0 0) 0x7fab140ac050 con 0x7fab1406e750 2023-10-06T04:17:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faafc003570 con 0x7fab1406e750 2023-10-06T04:17:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe30c014620 con 0x7fe3140b1db0 2023-10-06T04:17:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292618043 0 0) 0x7faafc003570 con 0x7fab1406e750 2023-10-06T04:17:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab140aa7e0 msgr2=0x7fab140aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab140aa7e0 0x7fab140aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 >> v1:172.21.15.83:6789/0 conn(0x7fab140ccd60 legacy=0x7fab140ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7f51e4b9e700 1 Processor -- start 2023-10-06T04:17:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140aac50 con 0x7fab1406e750 2023-10-06T04:17:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fab04001470 con 0x7fab1406e750 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 >> v1:172.21.15.37:6789/0 conn(0x7fab1406e750 legacy=0x7fab141559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc003a90 0x7faafc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc004810 0x7faafc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0051c0 0x7faafc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab140ad410 con 0x7faafc003a90 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc00c100 con 0x7faafc0051c0 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc00c2c0 con 0x7faafc004810 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0051c0 0x7faafc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fe3027fc700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe30c084810 con 0x7fe3140b1db0 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 -- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc004810 msgr2=0x7faafc004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc004810 0x7faafc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 -- 172.21.15.37:0/3190014085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc003a90 msgr2=0x7faafc003e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc003a90 0x7faafc003e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 -- 172.21.15.37:0/3190014085 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140aac50 con 0x7faafc0051c0 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.431+0000 7fcfaeffd700 1 -- 172.21.15.37:0/2885589408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800a680 con 0x7fcfb0155d70 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 -- 172.21.15.37:0/2885589408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 msgr2=0x7fcfb01561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 --2- 172.21.15.37:0/2885589408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb01561b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0070e20 tx=0x7fcfa8007760 comp rx=0 tx=0).stop 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 -- 172.21.15.37:0/2885589408 shutdown_connections 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 --2- 172.21.15.37:0/2885589408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb01561b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 --2- 172.21.15.37:0/2885589408 >> v2:172.21.15.83:3300/0 conn(0x7fcfb006ee60 0x7fcfb00aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 -- 172.21.15.37:0/2885589408 >> 172.21.15.37:0/2885589408 conn(0x7fcfb00cc250 msgr2=0x7fcfb00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7f45ae1a2700 1 Processor -- start 2023-10-06T04:17:07.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7f761c417700 1 -- 172.21.15.37:0/3332347084 shutdown_connections 2023-10-06T04:17:07.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fab19226700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0051c0 0x7faafc00ba60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c460 tx=0x7fab040079d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10f5e8aabd27646 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7f761c417700 1 -- 172.21.15.37:0/3332347084 wait complete. 2023-10-06T04:17:07.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fcfb6554700 1 -- 172.21.15.37:0/2885589408 shutdown_connections 2023-10-06T04:17:07.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7fe31259c700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7fcfb6554700 1 -- 172.21.15.37:0/2885589408 wait complete. 2023-10-06T04:17:07.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400cd90 con 0x7faafc0051c0 2023-10-06T04:17:07.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04005920 con 0x7faafc0051c0 2023-10-06T04:17:07.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7fab137fe700 1 -- 172.21.15.37:0/3190014085 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04005ce0 con 0x7faafc0051c0 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f45ae1a2700 1 -- start start 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45ae1a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45ae1a2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f45a80af990 0x7f45a8160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45ae1a2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80afdf0 con 0x7f45a815dbf0 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45ae1a2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a8160870 con 0x7f45a80af990 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45ae1a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80ac070 con 0x7f45a80b0390 2023-10-06T04:17:07.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f761c417700 1 Processor -- start 2023-10-06T04:17:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45a77fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f45a815dbf0 0x7f45a80ab960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:53640/0 (socket says 172.21.15.37:53640) 2023-10-06T04:17:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45a77fe700 1 -- 172.21.15.37:0/850450358 learned_addr learned my addr 172.21.15.37:0/850450358 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7fe31259c700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 0x7fe2f40693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe308006fd0 tx=0x7fe308006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fab1ac89700 1 -- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0051c0 msgr2=0x7faafc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fab1ac89700 1 --2- 172.21.15.37:0/3190014085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faafc0051c0 0x7faafc00ba60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c460 tx=0x7fab040079d0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fab19226700 1 -- 172.21.15.37:0/3190014085 reap_dead start 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fab1ac89700 1 -- 172.21.15.37:0/3190014085 shutdown_connections 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fab1ac89700 1 -- 172.21.15.37:0/3190014085 >> 172.21.15.37:0/3190014085 conn(0x7fab140cc250 msgr2=0x7fab140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7fab1ac89700 1 -- 172.21.15.37:0/3190014085 shutdown_connections 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7fab1ac89700 1 -- 172.21.15.37:0/3190014085 wait complete. 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.432+0000 7f51e4b9e700 1 -- start start 2023-10-06T04:17:07.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51e4b9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51e0157f20 0x7f51e00c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51e4b9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 0x7f51e00c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51e4b9e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00cb320 con 0x7f51e00c6c20 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51e4b9e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00c70a0 con 0x7f51e0157f20 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51e4b9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ca710 con 0x7f51e00ca1b0 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51df7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51e0157f20 0x7f51e00c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51deffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 0x7f51e00c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51df7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f51e0157f20 0x7f51e00c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40244/0 (socket says 172.21.15.37:40244) 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51deffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 0x7f51e00c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54666/0 (socket says 172.21.15.37:54666) 2023-10-06T04:17:07.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.433+0000 7f51df7fe700 1 -- 172.21.15.37:0/411455634 learned_addr learned my addr 172.21.15.37:0/411455634 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51df7fe700 1 -- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 msgr2=0x7f51e00c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51df7fe700 1 --2- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 0x7f51e00c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51df7fe700 1 -- 172.21.15.37:0/411455634 >> v1:172.21.15.37:6789/0 conn(0x7f51e00c6c20 legacy=0x7f51e0161610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51df7fe700 1 -- 172.21.15.37:0/411455634 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00ca9f0 con 0x7f51e0157f20 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51df7fe700 1 --2- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0157f20 0x7f51e00c9c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51d00099b0 tx=0x7f51d0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da5e5d836924c2fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51de7fc700 1 -- 172.21.15.37:0/411455634 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0009ea0 con 0x7f51e0157f20 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51de7fc700 1 -- 172.21.15.37:0/411455634 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000b820 con 0x7f51e0157f20 2023-10-06T04:17:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f51de7fc700 1 -- 172.21.15.37:0/411455634 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000bbc0 con 0x7f51e0157f20 2023-10-06T04:17:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f761c417700 1 -- start start 2023-10-06T04:17:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7fcfb6554700 1 Processor -- start 2023-10-06T04:17:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7fcfb6554700 1 -- start start 2023-10-06T04:17:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.434+0000 7f45a7fff700 1 --2- 172.21.15.37:0/850450358 >> v2:172.21.15.83:3300/0 conn(0x7f45a80af990 0x7f45a8160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a7fff700 1 -- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 msgr2=0x7f45a80af450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a7fff700 1 --2- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80af450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a7fff700 1 -- 172.21.15.37:0/850450358 >> v1:172.21.15.83:6789/0 conn(0x7f45a815dbf0 legacy=0x7f45a80ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a7fff700 1 -- 172.21.15.37:0/850450358 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a815fc60 con 0x7f45a80af990 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a7fff700 1 --2- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a8160d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009e60 tx=0x7f45a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dd30a74fd5c3b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 -- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0157f20 msgr2=0x7f51e00c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0157f20 0x7f51e00c9c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51d00099b0 tx=0x7f51d0009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 -- 172.21.15.37:0/411455634 shutdown_connections 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e0157f20 0x7f51e00c9c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/411455634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e00ca1b0 0x7f51e00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f51e4b9e700 1 -- 172.21.15.37:0/411455634 >> 172.21.15.37:0/411455634 conn(0x7f51e00cc0a0 msgr2=0x7f51e00cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f45a67fc700 1 -- 172.21.15.37:0/850450358 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000e070 con 0x7f45a80af990 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 0x7f7614097420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 0x7f7614097960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76141559a0 0x7f7614157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614097ea0 con 0x7f76140ccd60 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614099190 con 0x7f76141559a0 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.435+0000 7f761c417700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140980f0 con 0x7f76140ac7c0 2023-10-06T04:17:07.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f45a67fc700 1 -- 172.21.15.37:0/850450358 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000bb30 con 0x7f45a80af990 2023-10-06T04:17:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f76199b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 0x7f7614097960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f51e4b9e700 1 -- 172.21.15.37:0/411455634 shutdown_connections 2023-10-06T04:17:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f45a67fc700 1 -- 172.21.15.37:0/850450358 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0012430 con 0x7f45a80af990 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 0x7fcfb0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0158b40 con 0x7fcfb0155d70 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb014c1f0 con 0x7fcfb01559a0 2023-10-06T04:17:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fcfb6554700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb014c4d0 con 0x7fcfb006ee60 2023-10-06T04:17:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f51e4b9e700 1 -- 172.21.15.37:0/411455634 wait complete. 2023-10-06T04:17:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7fab1ac89700 1 Processor -- start 2023-10-06T04:17:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 -- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 msgr2=0x7f45a8160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a8160d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009e60 tx=0x7f45a0009780 comp rx=0 tx=0).stop 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f76199b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 0x7f7614097960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39914/0 (socket says 172.21.15.37:39914) 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f76199b2700 1 -- 172.21.15.37:0/9095856 learned_addr learned my addr 172.21.15.37:0/9095856 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 0x7f7614097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 -- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76141559a0 msgr2=0x7f7614157570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76141559a0 0x7f7614157570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 -- 172.21.15.37:0/9095856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 msgr2=0x7f7614097960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 0x7f7614097960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 -- 172.21.15.37:0/9095856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c00ab30 con 0x7f76140ac7c0 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.436+0000 7f761a1b3700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 0x7f7614097420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7604006d40 tx=0x7f7604009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:54686/0 (socket says 172.21.15.37:54686) 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 -- 172.21.15.37:0/188117912 learned_addr learned my addr 172.21.15.37:0/188117912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaf7fe700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 0x7fcfb0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 -- 172.21.15.37:0/850450358 shutdown_connections 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a8160d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/850450358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 -- 172.21.15.37:0/850450358 >> 172.21.15.37:0/850450358 conn(0x7f45a80680f0 msgr2=0x7f45a80cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fab1ac89700 1 -- start start 2023-10-06T04:17:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 -- 172.21.15.37:0/850450358 shutdown_connections 2023-10-06T04:17:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfb4af1700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 -- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 msgr2=0x7fcfb0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 0x7fcfb0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 -- 172.21.15.37:0/188117912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 msgr2=0x7fcfb014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 -- 172.21.15.37:0/188117912 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa800c050 con 0x7fcfb006ee60 2023-10-06T04:17:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaf7fe700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 0x7fcfb0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7f45ae1a2700 1 -- 172.21.15.37:0/850450358 wait complete. 2023-10-06T04:17:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fcfaffff700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c7c0 tx=0x7fcfa4007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604013680 con 0x7f76140ac7c0 2023-10-06T04:17:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7f51e4b9e700 1 Processor -- start 2023-10-06T04:17:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc0051c0 0x7fab14140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab14145280 0x7fab1414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14148330 con 0x7fab14145280 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14146330 con 0x7fab141467c0 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab1ac89700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab14145720 con 0x7faafc0051c0 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab13fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab13fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40296/0 (socket says 172.21.15.37:40296) 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fab13fff700 1 -- 172.21.15.37:0/1660127380 learned_addr learned my addr 172.21.15.37:0/1660127380 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 -- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc0051c0 msgr2=0x7fab14140fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc0051c0 0x7fab14140fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 -- 172.21.15.37:0/1660127380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab14145280 msgr2=0x7fab1414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab14145280 0x7fab1414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 -- 172.21.15.37:0/1660127380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14145a00 con 0x7fab141467c0 2023-10-06T04:17:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7fab13fff700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab0c007f00 tx=0x7fab0c009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7f51e4b9e700 1 -- start start 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00ca1b0 0x7f51e00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0157f20 0x7f51e00c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c5f90 con 0x7f51e00ca1b0 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0155590 con 0x7f51e00c6c20 2023-10-06T04:17:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51e4b9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c5cb0 con 0x7f51e0157f20 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76040137e0 con 0x7f76140ac7c0 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604013b60 con 0x7f76140ac7c0 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4005b30 con 0x7fcfb006ee60 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4005c90 con 0x7fcfb006ee60 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4004a80 con 0x7fcfb006ee60 2023-10-06T04:17:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f45ae1a2700 1 Processor -- start 2023-10-06T04:17:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40306/0 (socket says 172.21.15.37:40306) 2023-10-06T04:17:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51df7fe700 1 -- 172.21.15.37:0/2977101734 learned_addr learned my addr 172.21.15.37:0/2977101734 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51dffff700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0157f20 0x7f51e00c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f51deffd700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00ca1b0 0x7f51e00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb01587d0 con 0x7fcfb006ee60 2023-10-06T04:17:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.438+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb014bde0 con 0x7fcfb006ee60 2023-10-06T04:17:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.437+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe30c051920 con 0x7fe3140b1db0 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 -- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0157f20 msgr2=0x7f51e00c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0157f20 0x7f51e00c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 -- 172.21.15.37:0/2977101734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00ca1b0 msgr2=0x7f51e00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00ca1b0 0x7f51e00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 -- 172.21.15.37:0/2977101734 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00094f0 con 0x7f51e00c6c20 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00ec40 con 0x7fab141467c0 2023-10-06T04:17:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c00eda0 con 0x7fab141467c0 2023-10-06T04:17:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c014670 con 0x7fab141467c0 2023-10-06T04:17:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.439+0000 7f45ae1a2700 1 -- start start 2023-10-06T04:17:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51df7fe700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009290 tx=0x7f51d0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14145ce0 con 0x7fab141467c0 2023-10-06T04:17:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab14141500 con 0x7fab141467c0 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a816dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80a9430 con 0x7f45a815dbf0 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80a8390 con 0x7f45a80af990 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45ae1a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80a8670 con 0x7f45a80b0390 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39948/0 (socket says 172.21.15.37:39948) 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f45a7fff700 1 -- 172.21.15.37:0/2697799344 learned_addr learned my addr 172.21.15.37:0/2697799344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 -- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 msgr2=0x7f45a80a7b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80a7b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 -- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 msgr2=0x7f45a816dde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a816dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 -- 172.21.15.37:0/2697799344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009a20 con 0x7f45a815dbf0 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0011aa0 con 0x7f51e00c6c20 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0020070 con 0x7f51e00c6c20 2023-10-06T04:17:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.440+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0011e50 con 0x7f51e00c6c20 2023-10-06T04:17:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f45a7fff700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097c0 tx=0x7f45a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0154f40 con 0x7f51e00c6c20 2023-10-06T04:17:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e006abc0 con 0x7f51e00c6c20 2023-10-06T04:17:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a001b670 con 0x7f45a815dbf0 2023-10-06T04:17:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfa40070d0 con 0x7fcfb006ee60 2023-10-06T04:17:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a001b7f0 con 0x7f45a815dbf0 2023-10-06T04:17:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.441+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a001b9a0 con 0x7f45a815dbf0 2023-10-06T04:17:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76140983d0 con 0x7f76140ac7c0 2023-10-06T04:17:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7614098990 con 0x7f76140ac7c0 2023-10-06T04:17:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a80a8950 con 0x7f45a815dbf0 2023-10-06T04:17:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a80a8f10 con 0x7f45a815dbf0 2023-10-06T04:17:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7fcf97fff700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 0x7fcf9c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfa4083a50 con 0x7fcfb006ee60 2023-10-06T04:17:07.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.442+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14063410 con 0x7fab141467c0 2023-10-06T04:17:07.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.443+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a80a9130 con 0x7f45a815dbf0 2023-10-06T04:17:07.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.443+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab0c0149e0 con 0x7fab141467c0 2023-10-06T04:17:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.443+0000 7fcfaf7fe700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 0x7fcf9c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.444+0000 7fab10ff9700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 0x7fab000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.444+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab0c084d10 con 0x7fab141467c0 2023-10-06T04:17:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.444+0000 7fab18a25700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 0x7fab000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.444+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45a0024020 con 0x7f45a815dbf0 2023-10-06T04:17:07.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f458f7fe700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 0x7f45940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7fab18a25700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 0x7fab000693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab08007fd0 tx=0x7fab08007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45a0086b90 con 0x7f45a815dbf0 2023-10-06T04:17:07.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7fcfaf7fe700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 0x7fcf9c0694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0160980 tx=0x7fcfa00090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7614063410 con 0x7f76140ac7c0 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f45a77fe700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 0x7f45940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.446+0000 7f45a77fe700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 0x7f45940693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45980058d0 tx=0x7f4598007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0154da0 con 0x7f51e00c6c20 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51d0022030 con 0x7f51e00c6c20 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.446+0000 7f51c77fe700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 0x7f51cc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.446+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51d0086360 con 0x7f51e00c6c20 2023-10-06T04:17:07.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.446+0000 7f51deffd700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 0x7f51cc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.445+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf900052b0 con 0x7fcfb006ee60 2023-10-06T04:17:07.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.446+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f760400c460 con 0x7f76140ac7c0 2023-10-06T04:17:07.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.447+0000 7f51deffd700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 0x7f51cc069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51e015c6f0 tx=0x7f51d40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.447+0000 7f760a7fc700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.447+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7604084fb0 con 0x7f76140ac7c0 2023-10-06T04:17:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.447+0000 7f76199b2700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.448+0000 7f76199b2700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 0x7f75f80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7614099e30 tx=0x7f7610007f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.449+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab0c051e20 con 0x7fab141467c0 2023-10-06T04:17:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.450+0000 7f8196132700 1 Processor -- start 2023-10-06T04:17:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.450+0000 7f8196132700 1 -- start start 2023-10-06T04:17:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.450+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7604052140 con 0x7f76140ac7c0 2023-10-06T04:17:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.450+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45a0053ca0 con 0x7f45a815dbf0 2023-10-06T04:17:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f8196132700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f819015e3e0 0x7f81900b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f8196132700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8190161970 0x7f81900cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f80f0c83700 1 Processor -- start 2023-10-06T04:17:07.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f8196132700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8190068770 con 0x7f81900b0ab0 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f8196132700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81900b0ea0 con 0x7f8190161970 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f8196132700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8190161e00 con 0x7f819015e3e0 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8190161970 0x7f81900cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8190161970 0x7f81900cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39960/0 (socket says 172.21.15.37:39960) 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818effd700 1 -- 172.21.15.37:0/620559411 learned_addr learned my addr 172.21.15.37:0/620559411 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818f7fe700 1 --2- 172.21.15.37:0/620559411 >> v2:172.21.15.83:3300/0 conn(0x7f819015e3e0 0x7f81900b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818effd700 1 -- 172.21.15.37:0/620559411 >> v2:172.21.15.83:3300/0 conn(0x7f819015e3e0 msgr2=0x7f81900b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f818effd700 1 --2- 172.21.15.37:0/620559411 >> v2:172.21.15.83:3300/0 conn(0x7f819015e3e0 0x7f81900b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.452+0000 7f818effd700 1 -- 172.21.15.37:0/620559411 >> v1:172.21.15.83:6789/0 conn(0x7f81900b0ab0 legacy=0x7f819015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.452+0000 7f818effd700 1 -- 172.21.15.37:0/620559411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81901620e0 con 0x7f8190161970 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.452+0000 7f818effd700 1 --2- 172.21.15.37:0/620559411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8190161970 0x7f81900cc040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f819006f260 tx=0x7f8184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9fba5f588e81ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.451+0000 7f80f0c83700 1 -- start start 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.452+0000 7f80f0c83700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80ec1625c0 0x7f80ec0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.452+0000 7f80f0c83700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec06f5b0 0x7f80ec0af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80f0c83700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec161920 con 0x7f80ec1621f0 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80f0c83700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec06fb20 con 0x7f80ec1625c0 2023-10-06T04:17:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80f0c83700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0b0520 con 0x7f80ec06f5b0 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f818e7fc700 1 -- 172.21.15.37:0/620559411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184009e70 con 0x7f8190161970 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f80ec1625c0 0x7f80ec0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80ea59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f80ec1621f0 0x7f80ec0b0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:53658/0 (socket says 172.21.15.37:53658) 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80ea59c700 1 -- 172.21.15.37:0/574064194 learned_addr learned my addr 172.21.15.37:0/574064194 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f818e7fc700 1 -- 172.21.15.37:0/620559411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400b860 con 0x7f8190161970 2023-10-06T04:17:07.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f818e7fc700 1 -- 172.21.15.37:0/620559411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400bc00 con 0x7f8190161970 2023-10-06T04:17:07.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 -- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec06f5b0 msgr2=0x7f80ec0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:07.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 --2- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec06f5b0 0x7f80ec0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 -- 172.21.15.37:0/574064194 >> v1:172.21.15.83:6789/0 conn(0x7f80ec1621f0 legacy=0x7f80ec0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 -- 172.21.15.37:0/574064194 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0cdb80 con 0x7f80ec1625c0 2023-10-06T04:17:07.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e9d9b700 1 --2- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec0aede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098e0 tx=0x7f80dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db22131dc7ae0a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51e0154da0 con 0x7f51e00c6c20 2023-10-06T04:17:07.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.453+0000 7f80e959a700 1 -- 172.21.15.37:0/574064194 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc009e80 con 0x7f80ec1625c0 2023-10-06T04:17:07.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f80e959a700 1 -- 172.21.15.37:0/574064194 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00b860 con 0x7f80ec1625c0 2023-10-06T04:17:07.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f80e959a700 1 -- 172.21.15.37:0/574064194 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00bc20 con 0x7f80ec1625c0 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 -- 172.21.15.37:0/620559411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8190161970 msgr2=0x7f81900cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 --2- 172.21.15.37:0/620559411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8190161970 0x7f81900cc040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f819006f260 tx=0x7f8184009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 -- 172.21.15.37:0/620559411 shutdown_connections 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 --2- 172.21.15.37:0/620559411 >> v2:172.21.15.83:3300/0 conn(0x7f819015e3e0 0x7f81900b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 --2- 172.21.15.37:0/620559411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8190161970 0x7f81900cc040 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 -- 172.21.15.37:0/620559411 >> 172.21.15.37:0/620559411 conn(0x7f81900ce470 msgr2=0x7f81900ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 -- 172.21.15.37:0/620559411 shutdown_connections 2023-10-06T04:17:07.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.454+0000 7f8196132700 1 -- 172.21.15.37:0/620559411 wait complete. 2023-10-06T04:17:07.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.455+0000 7f80f0c83700 1 -- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 msgr2=0x7f80ec0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.455+0000 7f80f0c83700 1 --2- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec0aede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098e0 tx=0x7f80dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.456+0000 7f8196132700 1 Processor -- start 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.456+0000 7f8196132700 1 -- start start 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81900b0ab0 0x7f8190143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8190161970 0x7f8190147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190144f10 con 0x7f819015e3e0 2023-10-06T04:17:07.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901417c0 con 0x7f81900b0ab0 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.457+0000 7f8196132700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8190147650 con 0x7f8190161970 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39966/0 (socket says 172.21.15.37:39966) 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 -- 172.21.15.37:0/239101994 learned_addr learned my addr 172.21.15.37:0/239101994 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818ffff700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8190161970 0x7f8190147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 -- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8190161970 msgr2=0x7f8190147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8190161970 0x7f8190147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 -- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81900b0ab0 msgr2=0x7f8190143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81900b0ab0 0x7f8190143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 -- 172.21.15.37:0/239101994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094f0 con 0x7f819015e3e0 2023-10-06T04:17:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.458+0000 7f818effd700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81840094c0 tx=0x7f8184017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.459+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184000d10 con 0x7f819015e3e0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.459+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400bbe0 con 0x7f819015e3e0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.459+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818401a680 con 0x7f819015e3e0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.459+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8190141490 con 0x7f819015e3e0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.459+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81901453e0 con 0x7f819015e3e0 2023-10-06T04:17:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.455+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfa404b5a0 con 0x7fcfb006ee60 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.463+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81700052b0 con 0x7f819015e3e0 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.468+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f818401aa70 con 0x7f819015e3e0 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.468+0000 7f81777fe700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 0x7f817c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.468+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81840862a0 con 0x7f819015e3e0 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.469+0000 7f818f7fe700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 0x7f817c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.469+0000 7f818f7fe700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 0x7f817c069460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8180009ba0 tx=0x7f8180009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.474+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8184053310 con 0x7f819015e3e0 2023-10-06T04:17:07.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 -- 172.21.15.37:0/574064194 shutdown_connections 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 --2- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec06f5b0 0x7f80ec0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 --2- 172.21.15.37:0/574064194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec0aede0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 -- 172.21.15.37:0/574064194 >> 172.21.15.37:0/574064194 conn(0x7f80ec068770 msgr2=0x7f80ec068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 -- 172.21.15.37:0/574064194 shutdown_connections 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.480+0000 7f80f0c83700 1 -- 172.21.15.37:0/574064194 wait complete. 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.482+0000 7f80f0c83700 1 Processor -- start 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.482+0000 7f80f0c83700 1 -- start start 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 0x7f80ec1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec1621f0 0x7f80ec15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec155f20 con 0x7f80ec06f5b0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec151d40 con 0x7f80ec1625c0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.483+0000 7f80f0c83700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec156630 con 0x7f80ec1621f0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.484+0000 7f80e9d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec1621f0 0x7f80ec15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.484+0000 7f80ead9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.484+0000 7f80ead9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec15f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:40350/0 (socket says 172.21.15.37:40350) 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.484+0000 7f80ead9d700 1 -- 172.21.15.37:0/3724531492 learned_addr learned my addr 172.21.15.37:0/3724531492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 0x7f80ec1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 -- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec1621f0 msgr2=0x7f80ec15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec1621f0 0x7f80ec15f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 -- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 msgr2=0x7f80ec15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec15f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.485+0000 7f80ea59c700 1 -- 172.21.15.37:0/3724531492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc009420 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.486+0000 7f80ea59c700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 0x7f80ec1559e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80e400cca0 tx=0x7f80e4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.487+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4004bb0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.487+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4004d10 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.487+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400aa80 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.487+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec171e30 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.487+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec1723f0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.491+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80e40070f0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.492+0000 7f80e27fc700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 0x7f80d8069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.492+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80e40841f0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.493+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d00052b0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.498+0000 7f80e9d9b700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 0x7f80d8069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.502+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e404c5a0 con 0x7f80ec06f5b0 2023-10-06T04:17:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.527+0000 7f80e9d9b700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 0x7f80d8069650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098e0 tx=0x7f80dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.836+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f76140ab9a0 con 0x7f76140ac7c0 2023-10-06T04:17:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.836+0000 7f760a7fc700 1 -- 172.21.15.37:0/9095856 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7604055760 con 0x7f76140ac7c0 2023-10-06T04:17:07.840 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T04:17:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.837+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe3140b0000 con 0x7fe3140b1db0 2023-10-06T04:17:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.839+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 msgr2=0x7f75f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.839+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 0x7f75f80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7614099e30 tx=0x7f7610007f60 comp rx=0 tx=0).stop 2023-10-06T04:17:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.839+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 msgr2=0x7f7614097420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.839+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 0x7f7614097420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7604006d40 tx=0x7f7604009250 comp rx=0 tx=0).stop 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 shutdown_connections 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76141559a0 0x7f7614157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76140ac7c0 0x7f7614097420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 --2- 172.21.15.37:0/9095856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76140ccd60 0x7f7614097960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 >> 172.21.15.37:0/9095856 conn(0x7f76140cc250 msgr2=0x7f76140b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.840+0000 7fe3027fc700 1 -- 172.21.15.37:0/2128743196 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe30c054f40 con 0x7fe3140b1db0 2023-10-06T04:17:07.844 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 shutdown_connections 2023-10-06T04:17:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 msgr2=0x7fe2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 0x7fe2f40693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe308006fd0 tx=0x7fe308006bb0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 msgr2=0x7fe314172430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00bc60 tx=0x7fe30c009820 comp rx=0 tx=0).stop 2023-10-06T04:17:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.843+0000 7f761c417700 1 -- 172.21.15.37:0/9095856 wait complete. 2023-10-06T04:17:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 shutdown_connections 2023-10-06T04:17:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3140b1db0 0x7fe314172430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe2f4066f30 0x7fe2f40693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe31406ec90 0x7fe31414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 --2- 172.21.15.37:0/2128743196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3140ae820 0x7fe314171ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 >> 172.21.15.37:0/2128743196 conn(0x7fe3140cc250 msgr2=0x7fe3140b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.845+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 shutdown_connections 2023-10-06T04:17:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.846+0000 7fe31881f700 1 -- 172.21.15.37:0/2128743196 wait complete. 2023-10-06T04:17:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.850+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51e0154da0 con 0x7f51e00c6c20 2023-10-06T04:17:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.853+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45a8063410 con 0x7f45a815dbf0 2023-10-06T04:17:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.854+0000 7f51c77fe700 1 -- 172.21.15.37:0/2977101734 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51e0154da0 con 0x7f51e00c6c20 2023-10-06T04:17:07.857 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.855+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fab14165a50 con 0x7fab141467c0 2023-10-06T04:17:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.855+0000 7fab10ff9700 1 -- 172.21.15.37:0/1660127380 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab0c055440 con 0x7fab141467c0 2023-10-06T04:17:07.858 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T04:17:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.858+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcf90005560 con 0x7fcfb006ee60 2023-10-06T04:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.858+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 msgr2=0x7f51cc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 0x7f51cc069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51e015c6f0 tx=0x7f51d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 msgr2=0x7f51e00c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009290 tx=0x7f51d0016000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 msgr2=0x7fab000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 0x7fab000693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab08007fd0 tx=0x7fab08007b20 comp rx=0 tx=0).stop 2023-10-06T04:17:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 msgr2=0x7fab14144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab0c007f00 tx=0x7fab0c009810 comp rx=0 tx=0).stop 2023-10-06T04:17:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 shutdown_connections 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f51e0157f20 0x7f51e00c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f51cc066fb0 0x7f51cc069460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51e00c6c20 0x7f51e00c50d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 --2- 172.21.15.37:0/2977101734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e00ca1b0 0x7f51e00c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 >> 172.21.15.37:0/2977101734 conn(0x7f51e00cc0a0 msgr2=0x7f51e00c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 shutdown_connections 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f51e4b9e700 1 -- 172.21.15.37:0/2977101734 wait complete. 2023-10-06T04:17:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.859+0000 7f458f7fe700 1 -- 172.21.15.37:0/2697799344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45a002c090 con 0x7f45a815dbf0 2023-10-06T04:17:07.864 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 shutdown_connections 2023-10-06T04:17:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab14145280 0x7fab1414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faafc0051c0 0x7fab14140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab00066f30 0x7fab000693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 --2- 172.21.15.37:0/1660127380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab141467c0 0x7fab14144d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.860+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 >> 172.21.15.37:0/1660127380 conn(0x7fab140cc250 msgr2=0x7fab141559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-10-06T04:17:07.866 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 msgr2=0x7f45940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 0x7f45940693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45980058d0 tx=0x7f4598007a80 comp rx=0 tx=0).stop 2023-10-06T04:17:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 msgr2=0x7f45a80c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45a00097c0 tx=0x7f45a0018000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 shutdown_connections 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a815dbf0 0x7f45a80c24f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4594066f30 0x7f45940693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45a80af990 0x7f45a816dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 --2- 172.21.15.37:0/2697799344 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f45a80b0390 0x7f45a80a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.862+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 >> 172.21.15.37:0/2697799344 conn(0x7f45a80680f0 msgr2=0x7f45a80cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.863+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 shutdown_connections 2023-10-06T04:17:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.863+0000 7f45ae1a2700 1 -- 172.21.15.37:0/2697799344 wait complete. 2023-10-06T04:17:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.867+0000 7fcf97fff700 1 -- 172.21.15.37:0/188117912 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfa4050b40 con 0x7fcfb006ee60 2023-10-06T04:17:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.867+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 shutdown_connections 2023-10-06T04:17:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.867+0000 7fab1ac89700 1 -- 172.21.15.37:0/1660127380 wait complete. 2023-10-06T04:17:07.870 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T04:17:07.872 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.870+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 msgr2=0x7fcf9c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.870+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 0x7fcf9c0694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0160980 tx=0x7fcfa00090f0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.870+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 msgr2=0x7fcfb014c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.870+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c7c0 tx=0x7fcfa4007f70 comp rx=0 tx=0).stop 2023-10-06T04:17:07.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.874+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8170005560 con 0x7f819015e3e0 2023-10-06T04:17:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.874+0000 7f81777fe700 1 -- 172.21.15.37:0/239101994 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8184056930 con 0x7f819015e3e0 2023-10-06T04:17:07.877 INFO:teuthology.orchestra.run.smithi037.stdout:55834574858 2023-10-06T04:17:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 shutdown_connections 2023-10-06T04:17:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfb0155d70 0x7fcfb014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcfb006ee60 0x7fcfb014c8c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf9c067000 0x7fcf9c0694b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 --2- 172.21.15.37:0/188117912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfb01559a0 0x7fcfb0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 >> 172.21.15.37:0/188117912 conn(0x7fcfb00cc250 msgr2=0x7fcfb00ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 shutdown_connections 2023-10-06T04:17:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.875+0000 7fcfb6554700 1 -- 172.21.15.37:0/188117912 wait complete. 2023-10-06T04:17:07.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.877+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 msgr2=0x7f817c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.877+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 0x7f817c069460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8180009ba0 tx=0x7f8180009120 comp rx=0 tx=0).stop 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.877+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 msgr2=0x7f8190146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.877+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81840094c0 tx=0x7f8184017000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 shutdown_connections 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8190161970 0x7f8190147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f817c066fb0 0x7f817c069460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81900b0ab0 0x7f8190143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 --2- 172.21.15.37:0/239101994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819015e3e0 0x7f8190146bd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.878+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 >> 172.21.15.37:0/239101994 conn(0x7f81900ce470 msgr2=0x7f81900cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.882+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 shutdown_connections 2023-10-06T04:17:07.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-10-06T04:17:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.882+0000 7f8196132700 1 -- 172.21.15.37:0/239101994 wait complete. 2023-10-06T04:17:07.885 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-10-06T04:17:07.888 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T04:17:07.891 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.890+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f80d0005560 con 0x7f80ec06f5b0 2023-10-06T04:17:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.890+0000 7f80e27fc700 1 -- 172.21.15.37:0/3724531492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80e4018090 con 0x7f80ec06f5b0 2023-10-06T04:17:07.893 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 msgr2=0x7f80d8069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 0x7f80d8069650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0098e0 tx=0x7f80dc017000 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 msgr2=0x7f80ec1559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 0x7f80ec1559e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80e400cca0 tx=0x7f80e4001a10 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 shutdown_connections 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f80d80671a0 0x7f80d8069650 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80ec1625c0 0x7f80ec15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec06f5b0 0x7f80ec1559e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 --2- 172.21.15.37:0/3724531492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f80ec1621f0 0x7f80ec15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 >> 172.21.15.37:0/3724531492 conn(0x7f80ec068770 msgr2=0x7f80ec15bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 shutdown_connections 2023-10-06T04:17:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:07.893+0000 7f80f0c83700 1 -- 172.21.15.37:0/3724531492 wait complete. 2023-10-06T04:17:07.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-10-06T04:17:07.899 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-10-06T04:17:07.904 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-06T04:17:07.908 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:07.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:17:07.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:08.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.064+0000 7f48e3fc3700 1 Processor -- start 2023-10-06T04:17:08.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.064+0000 7f48e3fc3700 1 -- start start 2023-10-06T04:17:08.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e3fc3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48dc15dc70 0x7f48dc0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e3fc3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 0x7f48dc0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e3fc3700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc0ae9f0 con 0x7f48dc0b5e30 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e3fc3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0adb70 con 0x7f48dc15dc70 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e3fc3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0adde0 con 0x7f48dc0b6200 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e155e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48dc15dc70 0x7f48dc0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e1d5f700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48dc0b5e30 0x7f48dc15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58484/0 (socket says 172.21.15.37:58484) 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.065+0000 7f48e1d5f700 1 -- 172.21.15.37:0/2994883214 learned_addr learned my addr 172.21.15.37:0/2994883214 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e2560700 1 --2- 172.21.15.37:0/2994883214 >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 0x7f48dc0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e155e700 1 -- 172.21.15.37:0/2994883214 >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 msgr2=0x7f48dc0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e155e700 1 --2- 172.21.15.37:0/2994883214 >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 0x7f48dc0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e155e700 1 -- 172.21.15.37:0/2994883214 >> v1:172.21.15.37:6789/0 conn(0x7f48dc0b5e30 legacy=0x7f48dc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e0d5d700 1 -- 172.21.15.37:0/2994883214 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686585069 0 0) 0x7f48dc0ae9f0 con 0x7f48dc0b5e30 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e155e700 1 -- 172.21.15.37:0/2994883214 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0ae0c0 con 0x7f48dc15dc70 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e2560700 1 --2- 172.21.15.37:0/2994883214 >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 0x7f48dc0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e155e700 1 --2- 172.21.15.37:0/2994883214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc0ad0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48dc15af50 tx=0x7f48cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f42c62a34ea3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e0d5d700 1 -- 172.21.15.37:0/2994883214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00b6b0 con 0x7f48dc15dc70 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e0d5d700 1 -- 172.21.15.37:0/2994883214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc00b810 con 0x7f48dc15dc70 2023-10-06T04:17:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.066+0000 7f48e0d5d700 1 -- 172.21.15.37:0/2994883214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00bbb0 con 0x7f48dc15dc70 2023-10-06T04:17:08.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 -- 172.21.15.37:0/2994883214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 msgr2=0x7f48dc0ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/2994883214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc0ad0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48dc15af50 tx=0x7f48cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 -- 172.21.15.37:0/2994883214 shutdown_connections 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/2994883214 >> v2:172.21.15.83:3300/0 conn(0x7f48dc0b6200 0x7f48dc0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/2994883214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc0ad0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 -- 172.21.15.37:0/2994883214 >> 172.21.15.37:0/2994883214 conn(0x7f48dc099a10 msgr2=0x7f48dc06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 -- 172.21.15.37:0/2994883214 shutdown_connections 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.067+0000 7f48e3fc3700 1 -- 172.21.15.37:0/2994883214 wait complete. 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 Processor -- start 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 -- start start 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 0x7f48dc16a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 0x7f48dc142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc16acb0 con 0x7f48dc15dc70 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1523b0 con 0x7f48dc0b6200 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.068+0000 7f48e3fc3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc152690 con 0x7f48dc0b5e30 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39990/0 (socket says 172.21.15.37:39990) 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 -- 172.21.15.37:0/3830472566 learned_addr learned my addr 172.21.15.37:0/3830472566 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:08.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e155e700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 0x7f48dc142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e1d5f700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 0x7f48dc16a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 -- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 msgr2=0x7f48dc16a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 0x7f48dc16a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 -- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 msgr2=0x7f48dc142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 0x7f48dc142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 -- 172.21.15.37:0/3830472566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc009420 con 0x7f48dc15dc70 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e155e700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 0x7f48dc142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e1d5f700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 0x7f48dc16a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e2560700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48d800a380 tx=0x7f48d80078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800ae10 con 0x7f48dc15dc70 2023-10-06T04:17:08.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800d650 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc152970 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800da10 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.069+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc152f30 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.070+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc0b2f90 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.070+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d8003020 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.071+0000 7f48d1ffb700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 0x7f48c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.071+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f48d8084e90 con 0x7f48dc15dc70 2023-10-06T04:17:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.071+0000 7f48e1d5f700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 0x7f48c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.072+0000 7f48e1d5f700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 0x7f48c00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48d40018d0 tx=0x7f48d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.075+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48d804d5a0 con 0x7f48dc15dc70 2023-10-06T04:17:08.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.265+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48dc0ae3a0 con 0x7f48c0066f30 2023-10-06T04:17:08.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.274+0000 7f48d1ffb700 1 -- 172.21.15.37:0/3830472566 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286599 (secure 0 0 0) 0x7f48dc0ae3a0 con 0x7f48c0066f30 2023-10-06T04:17:08.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 msgr2=0x7f48c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 0x7f48c00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48d40018d0 tx=0x7f48d4009040 comp rx=0 tx=0).stop 2023-10-06T04:17:08.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 msgr2=0x7f48dc153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48d800a380 tx=0x7f48d80078f0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 shutdown_connections 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48dc15dc70 0x7f48dc153d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48dc0b5e30 0x7f48dc16a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f48c0066f30 0x7f48c00693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 --2- 172.21.15.37:0/3830472566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48dc0b6200 0x7f48dc142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 >> 172.21.15.37:0/3830472566 conn(0x7f48dc099a10 msgr2=0x7f48dc151570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 shutdown_connections 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.277+0000 7f48e3fc3700 1 -- 172.21.15.37:0/3830472566 wait complete. 2023-10-06T04:17:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:08.291 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T04:17:07.485533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381416,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593304,"statfs":{"total":773094113280,"available":770655543296,"internally_reserved":0,"allocated":3186688,"data_stored":1899900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675807+0000","last_change":"2023-10-06T04:16:56.668658+0000","last_active":"2023-10-06T04:16:56.675807+0000","last_peered":"2023-10-06T04:16:56.675807+0000","last_clean":"2023-10-06T04:16:56.675807+0000","last_became_active":"2023-10-06T04:16:56.668367+0000","last_became_peered":"2023-10-06T04:16:56.668367+0000","last_unstale":"2023-10-06T04:16:56.675807+0000","last_undegraded":"2023-10-06T04:16:56.675807+0000","last_fullsized":"2023-10-06T04:16:56.675807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668025+0000","last_change":"2023-10-06T04:16:56.662736+0000","last_active":"2023-10-06T04:16:56.668025+0000","last_peered":"2023-10-06T04:16:56.668025+0000","last_clean":"2023-10-06T04:16:56.668025+0000","last_became_active":"2023-10-06T04:16:56.662469+0000","last_became_peered":"2023-10-06T04:16:56.662469+0000","last_unstale":"2023-10-06T04:16:56.668025+0000","last_undegraded":"2023-10-06T04:16:56.668025+0000","last_fullsized":"2023-10-06T04:16:56.668025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672509+0000","last_change":"2023-10-06T04:16:56.670653+0000","last_active":"2023-10-06T04:16:56.672509+0000","last_peered":"2023-10-06T04:16:56.672509+0000","last_clean":"2023-10-06T04:16:56.672509+0000","last_became_active":"2023-10-06T04:16:56.670416+0000","last_became_peered":"2023-10-06T04:16:56.670416+0000","last_unstale":"2023-10-06T04:16:56.672509+0000","last_undegraded":"2023-10-06T04:16:56.672509+0000","last_fullsized":"2023-10-06T04:16:56.672509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:11.137952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672609+0000","last_change":"2023-10-06T04:16:56.669774+0000","last_active":"2023-10-06T04:16:56.672609+0000","last_peered":"2023-10-06T04:16:56.672609+0000","last_clean":"2023-10-06T04:16:56.672609+0000","last_became_active":"2023-10-06T04:16:56.669493+0000","last_became_peered":"2023-10-06T04:16:56.669493+0000","last_unstale":"2023-10-06T04:16:56.672609+0000","last_undegraded":"2023-10-06T04:16:56.672609+0000","last_fullsized":"2023-10-06T04:16:56.672609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676488+0000","last_change":"2023-10-06T04:16:56.672513+0000","last_active":"2023-10-06T04:16:56.676488+0000","last_peered":"2023-10-06T04:16:56.676488+0000","last_clean":"2023-10-06T04:16:56.676488+0000","last_became_active":"2023-10-06T04:16:56.672282+0000","last_became_peered":"2023-10-06T04:16:56.672282+0000","last_unstale":"2023-10-06T04:16:56.676488+0000","last_undegraded":"2023-10-06T04:16:56.676488+0000","last_fullsized":"2023-10-06T04:16:56.676488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675009+0000","last_change":"2023-10-06T04:16:56.674519+0000","last_active":"2023-10-06T04:16:56.675009+0000","last_peered":"2023-10-06T04:16:56.675009+0000","last_clean":"2023-10-06T04:16:56.675009+0000","last_became_active":"2023-10-06T04:16:56.674243+0000","last_became_peered":"2023-10-06T04:16:56.674243+0000","last_unstale":"2023-10-06T04:16:56.675009+0000","last_undegraded":"2023-10-06T04:16:56.675009+0000","last_fullsized":"2023-10-06T04:16:56.675009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:52.285904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673077+0000","last_change":"2023-10-06T04:16:56.670881+0000","last_active":"2023-10-06T04:16:56.673077+0000","last_peered":"2023-10-06T04:16:56.673077+0000","last_clean":"2023-10-06T04:16:56.673077+0000","last_became_active":"2023-10-06T04:16:56.670084+0000","last_became_peered":"2023-10-06T04:16:56.670084+0000","last_unstale":"2023-10-06T04:16:56.673077+0000","last_undegraded":"2023-10-06T04:16:56.673077+0000","last_fullsized":"2023-10-06T04:16:56.673077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664646+0000","last_change":"2023-10-06T04:16:56.659682+0000","last_active":"2023-10-06T04:16:56.664646+0000","last_peered":"2023-10-06T04:16:56.664646+0000","last_clean":"2023-10-06T04:16:56.664646+0000","last_became_active":"2023-10-06T04:16:56.659343+0000","last_became_peered":"2023-10-06T04:16:56.659343+0000","last_unstale":"2023-10-06T04:16:56.664646+0000","last_undegraded":"2023-10-06T04:16:56.664646+0000","last_fullsized":"2023-10-06T04:16:56.664646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678987+0000","last_change":"2023-10-06T04:16:56.677372+0000","last_active":"2023-10-06T04:16:56.678987+0000","last_peered":"2023-10-06T04:16:56.678987+0000","last_clean":"2023-10-06T04:16:56.678987+0000","last_became_active":"2023-10-06T04:16:56.677105+0000","last_became_peered":"2023-10-06T04:16:56.677105+0000","last_unstale":"2023-10-06T04:16:56.678987+0000","last_undegraded":"2023-10-06T04:16:56.678987+0000","last_fullsized":"2023-10-06T04:16:56.678987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678358+0000","last_change":"2023-10-06T04:16:56.677091+0000","last_active":"2023-10-06T04:16:56.678358+0000","last_peered":"2023-10-06T04:16:56.678358+0000","last_clean":"2023-10-06T04:16:56.678358+0000","last_became_active":"2023-10-06T04:16:56.676847+0000","last_became_peered":"2023-10-06T04:16:56.676847+0000","last_unstale":"2023-10-06T04:16:56.678358+0000","last_undegraded":"2023-10-06T04:16:56.678358+0000","last_fullsized":"2023-10-06T04:16:56.678358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665750+0000","last_change":"2023-10-06T04:16:56.662284+0000","last_active":"2023-10-06T04:16:56.665750+0000","last_peered":"2023-10-06T04:16:56.665750+0000","last_clean":"2023-10-06T04:16:56.665750+0000","last_became_active":"2023-10-06T04:16:56.662013+0000","last_became_peered":"2023-10-06T04:16:56.662013+0000","last_unstale":"2023-10-06T04:16:56.665750+0000","last_undegraded":"2023-10-06T04:16:56.665750+0000","last_fullsized":"2023-10-06T04:16:56.665750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662752+0000","last_change":"2023-10-06T04:16:56.659881+0000","last_active":"2023-10-06T04:16:56.662752+0000","last_peered":"2023-10-06T04:16:56.662752+0000","last_clean":"2023-10-06T04:16:56.662752+0000","last_became_active":"2023-10-06T04:16:56.659565+0000","last_became_peered":"2023-10-06T04:16:56.659565+0000","last_unstale":"2023-10-06T04:16:56.662752+0000","last_undegraded":"2023-10-06T04:16:56.662752+0000","last_fullsized":"2023-10-06T04:16:56.662752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.667677+0000","last_change":"2023-10-06T04:16:56.662578+0000","last_active":"2023-10-06T04:16:56.667677+0000","last_peered":"2023-10-06T04:16:56.667677+0000","last_clean":"2023-10-06T04:16:56.667677+0000","last_became_active":"2023-10-06T04:16:56.662288+0000","last_became_peered":"2023-10-06T04:16:56.662288+0000","last_unstale":"2023-10-06T04:16:56.667677+0000","last_undegraded":"2023-10-06T04:16:56.667677+0000","last_fullsized":"2023-10-06T04:16:56.667677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.659914+0000","last_change":"2023-10-06T04:16:56.659075+0000","last_active":"2023-10-06T04:16:56.659914+0000","last_peered":"2023-10-06T04:16:56.659914+0000","last_clean":"2023-10-06T04:16:56.659914+0000","last_became_active":"2023-10-06T04:16:56.658630+0000","last_became_peered":"2023-10-06T04:16:56.658630+0000","last_unstale":"2023-10-06T04:16:56.659914+0000","last_undegraded":"2023-10-06T04:16:56.659914+0000","last_fullsized":"2023-10-06T04:16:56.659914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672766+0000","last_change":"2023-10-06T04:16:56.670918+0000","last_active":"2023-10-06T04:16:56.672766+0000","last_peered":"2023-10-06T04:16:56.672766+0000","last_clean":"2023-10-06T04:16:56.672766+0000","last_became_active":"2023-10-06T04:16:56.670638+0000","last_became_peered":"2023-10-06T04:16:56.670638+0000","last_unstale":"2023-10-06T04:16:56.672766+0000","last_undegraded":"2023-10-06T04:16:56.672766+0000","last_fullsized":"2023-10-06T04:16:56.672766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672225+0000","last_change":"2023-10-06T04:16:56.670135+0000","last_active":"2023-10-06T04:16:56.672225+0000","last_peered":"2023-10-06T04:16:56.672225+0000","last_clean":"2023-10-06T04:16:56.672225+0000","last_became_active":"2023-10-06T04:16:56.669855+0000","last_became_peered":"2023-10-06T04:16:56.669855+0000","last_unstale":"2023-10-06T04:16:56.672225+0000","last_undegraded":"2023-10-06T04:16:56.672225+0000","last_fullsized":"2023-10-06T04:16:56.672225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:49.318756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676508+0000","last_change":"2023-10-06T04:16:56.673235+0000","last_active":"2023-10-06T04:16:56.676508+0000","last_peered":"2023-10-06T04:16:56.676508+0000","last_clean":"2023-10-06T04:16:56.676508+0000","last_became_active":"2023-10-06T04:16:56.672853+0000","last_became_peered":"2023-10-06T04:16:56.672853+0000","last_unstale":"2023-10-06T04:16:56.676508+0000","last_undegraded":"2023-10-06T04:16:56.676508+0000","last_fullsized":"2023-10-06T04:16:56.676508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666241+0000","last_change":"2023-10-06T04:16:56.663344+0000","last_active":"2023-10-06T04:16:56.666241+0000","last_peered":"2023-10-06T04:16:56.666241+0000","last_clean":"2023-10-06T04:16:56.666241+0000","last_became_active":"2023-10-06T04:16:56.663082+0000","last_became_peered":"2023-10-06T04:16:56.663082+0000","last_unstale":"2023-10-06T04:16:56.666241+0000","last_undegraded":"2023-10-06T04:16:56.666241+0000","last_fullsized":"2023-10-06T04:16:56.666241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:52.653960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671682+0000","last_change":"2023-10-06T04:16:56.667309+0000","last_active":"2023-10-06T04:16:56.671682+0000","last_peered":"2023-10-06T04:16:56.671682+0000","last_clean":"2023-10-06T04:16:56.671682+0000","last_became_active":"2023-10-06T04:16:56.666994+0000","last_became_peered":"2023-10-06T04:16:56.666994+0000","last_unstale":"2023-10-06T04:16:56.671682+0000","last_undegraded":"2023-10-06T04:16:56.671682+0000","last_fullsized":"2023-10-06T04:16:56.671682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671578+0000","last_change":"2023-10-06T04:16:56.666711+0000","last_active":"2023-10-06T04:16:56.671578+0000","last_peered":"2023-10-06T04:16:56.671578+0000","last_clean":"2023-10-06T04:16:56.671578+0000","last_became_active":"2023-10-06T04:16:56.666304+0000","last_became_peered":"2023-10-06T04:16:56.666304+0000","last_unstale":"2023-10-06T04:16:56.671578+0000","last_undegraded":"2023-10-06T04:16:56.671578+0000","last_fullsized":"2023-10-06T04:16:56.671578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:42.947434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673120+0000","last_change":"2023-10-06T04:16:56.671995+0000","last_active":"2023-10-06T04:16:56.673120+0000","last_peered":"2023-10-06T04:16:56.673120+0000","last_clean":"2023-10-06T04:16:56.673120+0000","last_became_active":"2023-10-06T04:16:56.671358+0000","last_became_peered":"2023-10-06T04:16:56.671358+0000","last_unstale":"2023-10-06T04:16:56.673120+0000","last_undegraded":"2023-10-06T04:16:56.673120+0000","last_fullsized":"2023-10-06T04:16:56.673120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676631+0000","last_change":"2023-10-06T04:16:56.674623+0000","last_active":"2023-10-06T04:16:56.676631+0000","last_peered":"2023-10-06T04:16:56.676631+0000","last_clean":"2023-10-06T04:16:56.676631+0000","last_became_active":"2023-10-06T04:16:56.674251+0000","last_became_peered":"2023-10-06T04:16:56.674251+0000","last_unstale":"2023-10-06T04:16:56.676631+0000","last_undegraded":"2023-10-06T04:16:56.676631+0000","last_fullsized":"2023-10-06T04:16:56.676631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676774+0000","last_change":"2023-10-06T04:16:56.672200+0000","last_active":"2023-10-06T04:16:56.676774+0000","last_peered":"2023-10-06T04:16:56.676774+0000","last_clean":"2023-10-06T04:16:56.676774+0000","last_became_active":"2023-10-06T04:16:56.671885+0000","last_became_peered":"2023-10-06T04:16:56.671885+0000","last_unstale":"2023-10-06T04:16:56.676774+0000","last_undegraded":"2023-10-06T04:16:56.676774+0000","last_fullsized":"2023-10-06T04:16:56.676774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672217+0000","last_change":"2023-10-06T04:16:56.669907+0000","last_active":"2023-10-06T04:16:56.672217+0000","last_peered":"2023-10-06T04:16:56.672217+0000","last_clean":"2023-10-06T04:16:56.672217+0000","last_became_active":"2023-10-06T04:16:56.669630+0000","last_became_peered":"2023-10-06T04:16:56.669630+0000","last_unstale":"2023-10-06T04:16:56.672217+0000","last_undegraded":"2023-10-06T04:16:56.672217+0000","last_fullsized":"2023-10-06T04:16:56.672217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671424+0000","last_change":"2023-10-06T04:16:56.667673+0000","last_active":"2023-10-06T04:16:56.671424+0000","last_peered":"2023-10-06T04:16:56.671424+0000","last_clean":"2023-10-06T04:16:56.671424+0000","last_became_active":"2023-10-06T04:16:56.667408+0000","last_became_peered":"2023-10-06T04:16:56.667408+0000","last_unstale":"2023-10-06T04:16:56.671424+0000","last_undegraded":"2023-10-06T04:16:56.671424+0000","last_fullsized":"2023-10-06T04:16:56.671424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669519+0000","last_change":"2023-10-06T04:16:56.665187+0000","last_active":"2023-10-06T04:16:56.669519+0000","last_peered":"2023-10-06T04:16:56.669519+0000","last_clean":"2023-10-06T04:16:56.669519+0000","last_became_active":"2023-10-06T04:16:56.664852+0000","last_became_peered":"2023-10-06T04:16:56.664852+0000","last_unstale":"2023-10-06T04:16:56.669519+0000","last_undegraded":"2023-10-06T04:16:56.669519+0000","last_fullsized":"2023-10-06T04:16:56.669519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669427+0000","last_change":"2023-10-06T04:16:56.665892+0000","last_active":"2023-10-06T04:16:56.669427+0000","last_peered":"2023-10-06T04:16:56.669427+0000","last_clean":"2023-10-06T04:16:56.669427+0000","last_became_active":"2023-10-06T04:16:56.665587+0000","last_became_peered":"2023-10-06T04:16:56.665587+0000","last_unstale":"2023-10-06T04:16:56.669427+0000","last_undegraded":"2023-10-06T04:16:56.669427+0000","last_fullsized":"2023-10-06T04:16:56.669427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.690846+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:56.690846+0000","last_peered":"2023-10-06T04:16:56.690846+0000","last_clean":"2023-10-06T04:16:56.690846+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:56.690846+0000","last_undegraded":"2023-10-06T04:16:56.690846+0000","last_fullsized":"2023-10-06T04:16:56.690846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676137+0000","last_change":"2023-10-06T04:16:56.669519+0000","last_active":"2023-10-06T04:16:56.676137+0000","last_peered":"2023-10-06T04:16:56.676137+0000","last_clean":"2023-10-06T04:16:56.676137+0000","last_became_active":"2023-10-06T04:16:56.669197+0000","last_became_peered":"2023-10-06T04:16:56.669197+0000","last_unstale":"2023-10-06T04:16:56.676137+0000","last_undegraded":"2023-10-06T04:16:56.676137+0000","last_fullsized":"2023-10-06T04:16:56.676137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658364+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:56.658364+0000","last_peered":"2023-10-06T04:16:56.658364+0000","last_clean":"2023-10-06T04:16:56.658364+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:56.658364+0000","last_undegraded":"2023-10-06T04:16:56.658364+0000","last_fullsized":"2023-10-06T04:16:56.658364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677416+0000","last_change":"2023-10-06T04:16:56.673577+0000","last_active":"2023-10-06T04:16:56.677416+0000","last_peered":"2023-10-06T04:16:56.677416+0000","last_clean":"2023-10-06T04:16:56.677416+0000","last_became_active":"2023-10-06T04:16:56.672105+0000","last_became_peered":"2023-10-06T04:16:56.672105+0000","last_unstale":"2023-10-06T04:16:56.677416+0000","last_undegraded":"2023-10-06T04:16:56.677416+0000","last_fullsized":"2023-10-06T04:16:56.677416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657761+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:56.657761+0000","last_peered":"2023-10-06T04:16:56.657761+0000","last_clean":"2023-10-06T04:16:56.657761+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:56.657761+0000","last_undegraded":"2023-10-06T04:16:56.657761+0000","last_fullsized":"2023-10-06T04:16:56.657761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672585+0000","last_change":"2023-10-06T04:16:56.669053+0000","last_active":"2023-10-06T04:16:56.672585+0000","last_peered":"2023-10-06T04:16:56.672585+0000","last_clean":"2023-10-06T04:16:56.672585+0000","last_became_active":"2023-10-06T04:16:56.668550+0000","last_became_peered":"2023-10-06T04:16:56.668550+0000","last_unstale":"2023-10-06T04:16:56.672585+0000","last_undegraded":"2023-10-06T04:16:56.672585+0000","last_fullsized":"2023-10-06T04:16:56.672585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663592+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:56.663592+0000","last_peered":"2023-10-06T04:16:56.663592+0000","last_clean":"2023-10-06T04:16:56.663592+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:56.663592+0000","last_undegraded":"2023-10-06T04:16:56.663592+0000","last_fullsized":"2023-10-06T04:16:56.663592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676739+0000","last_change":"2023-10-06T04:16:56.673953+0000","last_active":"2023-10-06T04:16:56.676739+0000","last_peered":"2023-10-06T04:16:56.676739+0000","last_clean":"2023-10-06T04:16:56.676739+0000","last_became_active":"2023-10-06T04:16:56.672796+0000","last_became_peered":"2023-10-06T04:16:56.672796+0000","last_unstale":"2023-10-06T04:16:56.676739+0000","last_undegraded":"2023-10-06T04:16:56.676739+0000","last_fullsized":"2023-10-06T04:16:56.676739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655148+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:56.655148+0000","last_peered":"2023-10-06T04:16:56.655148+0000","last_clean":"2023-10-06T04:16:56.655148+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:56.655148+0000","last_undegraded":"2023-10-06T04:16:56.655148+0000","last_fullsized":"2023-10-06T04:16:56.655148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676749+0000","last_change":"2023-10-06T04:16:56.671605+0000","last_active":"2023-10-06T04:16:56.676749+0000","last_peered":"2023-10-06T04:16:56.676749+0000","last_clean":"2023-10-06T04:16:56.676749+0000","last_became_active":"2023-10-06T04:16:56.670359+0000","last_became_peered":"2023-10-06T04:16:56.670359+0000","last_unstale":"2023-10-06T04:16:56.676749+0000","last_undegraded":"2023-10-06T04:16:56.676749+0000","last_fullsized":"2023-10-06T04:16:56.676749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694597+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:56.694597+0000","last_peered":"2023-10-06T04:16:56.694597+0000","last_clean":"2023-10-06T04:16:56.694597+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:56.694597+0000","last_undegraded":"2023-10-06T04:16:56.694597+0000","last_fullsized":"2023-10-06T04:16:56.694597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671837+0000","last_change":"2023-10-06T04:16:56.666797+0000","last_active":"2023-10-06T04:16:56.671837+0000","last_peered":"2023-10-06T04:16:56.671837+0000","last_clean":"2023-10-06T04:16:56.671837+0000","last_became_active":"2023-10-06T04:16:56.666505+0000","last_became_peered":"2023-10-06T04:16:56.666505+0000","last_unstale":"2023-10-06T04:16:56.671837+0000","last_undegraded":"2023-10-06T04:16:56.671837+0000","last_fullsized":"2023-10-06T04:16:56.671837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694444+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:56.694444+0000","last_peered":"2023-10-06T04:16:56.694444+0000","last_clean":"2023-10-06T04:16:56.694444+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:56.694444+0000","last_undegraded":"2023-10-06T04:16:56.694444+0000","last_fullsized":"2023-10-06T04:16:56.694444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672149+0000","last_change":"2023-10-06T04:16:56.668378+0000","last_active":"2023-10-06T04:16:56.672149+0000","last_peered":"2023-10-06T04:16:56.672149+0000","last_clean":"2023-10-06T04:16:56.672149+0000","last_became_active":"2023-10-06T04:16:56.668083+0000","last_became_peered":"2023-10-06T04:16:56.668083+0000","last_unstale":"2023-10-06T04:16:56.672149+0000","last_undegraded":"2023-10-06T04:16:56.672149+0000","last_fullsized":"2023-10-06T04:16:56.672149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:03.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692795+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:56.692795+0000","last_peered":"2023-10-06T04:16:56.692795+0000","last_clean":"2023-10-06T04:16:56.692795+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:56.692795+0000","last_undegraded":"2023-10-06T04:16:56.692795+0000","last_fullsized":"2023-10-06T04:16:56.692795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676685+0000","last_change":"2023-10-06T04:16:56.671592+0000","last_active":"2023-10-06T04:16:56.676685+0000","last_peered":"2023-10-06T04:16:56.676685+0000","last_clean":"2023-10-06T04:16:56.676685+0000","last_became_active":"2023-10-06T04:16:56.671299+0000","last_became_peered":"2023-10-06T04:16:56.671299+0000","last_unstale":"2023-10-06T04:16:56.676685+0000","last_undegraded":"2023-10-06T04:16:56.676685+0000","last_fullsized":"2023-10-06T04:16:56.676685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668158+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:56.668158+0000","last_peered":"2023-10-06T04:16:56.668158+0000","last_clean":"2023-10-06T04:16:56.668158+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:56.668158+0000","last_undegraded":"2023-10-06T04:16:56.668158+0000","last_fullsized":"2023-10-06T04:16:56.668158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669445+0000","last_change":"2023-10-06T04:16:56.665896+0000","last_active":"2023-10-06T04:16:56.669445+0000","last_peered":"2023-10-06T04:16:56.669445+0000","last_clean":"2023-10-06T04:16:56.669445+0000","last_became_active":"2023-10-06T04:16:56.665600+0000","last_became_peered":"2023-10-06T04:16:56.665600+0000","last_unstale":"2023-10-06T04:16:56.669445+0000","last_undegraded":"2023-10-06T04:16:56.669445+0000","last_fullsized":"2023-10-06T04:16:56.669445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662564+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:56.662564+0000","last_peered":"2023-10-06T04:16:56.662564+0000","last_clean":"2023-10-06T04:16:56.662564+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:56.662564+0000","last_undegraded":"2023-10-06T04:16:56.662564+0000","last_fullsized":"2023-10-06T04:16:56.662564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677435+0000","last_change":"2023-10-06T04:16:56.673632+0000","last_active":"2023-10-06T04:16:56.677435+0000","last_peered":"2023-10-06T04:16:56.677435+0000","last_clean":"2023-10-06T04:16:56.677435+0000","last_became_active":"2023-10-06T04:16:56.673351+0000","last_became_peered":"2023-10-06T04:16:56.673351+0000","last_unstale":"2023-10-06T04:16:56.677435+0000","last_undegraded":"2023-10-06T04:16:56.677435+0000","last_fullsized":"2023-10-06T04:16:56.677435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.695221+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:56.695221+0000","last_peered":"2023-10-06T04:16:56.695221+0000","last_clean":"2023-10-06T04:16:56.695221+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:56.695221+0000","last_undegraded":"2023-10-06T04:16:56.695221+0000","last_fullsized":"2023-10-06T04:16:56.695221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676351+0000","last_change":"2023-10-06T04:16:56.670186+0000","last_active":"2023-10-06T04:16:56.676351+0000","last_peered":"2023-10-06T04:16:56.676351+0000","last_clean":"2023-10-06T04:16:56.676351+0000","last_became_active":"2023-10-06T04:16:56.669792+0000","last_became_peered":"2023-10-06T04:16:56.669792+0000","last_unstale":"2023-10-06T04:16:56.676351+0000","last_undegraded":"2023-10-06T04:16:56.676351+0000","last_fullsized":"2023-10-06T04:16:56.676351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692671+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:56.692671+0000","last_peered":"2023-10-06T04:16:56.692671+0000","last_clean":"2023-10-06T04:16:56.692671+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:56.692671+0000","last_undegraded":"2023-10-06T04:16:56.692671+0000","last_fullsized":"2023-10-06T04:16:56.692671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669397+0000","last_change":"2023-10-06T04:16:56.666338+0000","last_active":"2023-10-06T04:16:56.669397+0000","last_peered":"2023-10-06T04:16:56.669397+0000","last_clean":"2023-10-06T04:16:56.669397+0000","last_became_active":"2023-10-06T04:16:56.666070+0000","last_became_peered":"2023-10-06T04:16:56.666070+0000","last_unstale":"2023-10-06T04:16:56.669397+0000","last_undegraded":"2023-10-06T04:16:56.669397+0000","last_fullsized":"2023-10-06T04:16:56.669397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692755+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:56.692755+0000","last_peered":"2023-10-06T04:16:56.692755+0000","last_clean":"2023-10-06T04:16:56.692755+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:56.692755+0000","last_undegraded":"2023-10-06T04:16:56.692755+0000","last_fullsized":"2023-10-06T04:16:56.692755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670632+0000","last_change":"2023-10-06T04:16:56.665346+0000","last_active":"2023-10-06T04:16:56.670632+0000","last_peered":"2023-10-06T04:16:56.670632+0000","last_clean":"2023-10-06T04:16:56.670632+0000","last_became_active":"2023-10-06T04:16:56.665106+0000","last_became_peered":"2023-10-06T04:16:56.665106+0000","last_unstale":"2023-10-06T04:16:56.670632+0000","last_undegraded":"2023-10-06T04:16:56.670632+0000","last_fullsized":"2023-10-06T04:16:56.670632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:08.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693453+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:56.693453+0000","last_peered":"2023-10-06T04:16:56.693453+0000","last_clean":"2023-10-06T04:16:56.693453+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:56.693453+0000","last_undegraded":"2023-10-06T04:16:56.693453+0000","last_fullsized":"2023-10-06T04:16:56.693453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674138+0000","last_change":"2023-10-06T04:16:56.672813+0000","last_active":"2023-10-06T04:16:56.674138+0000","last_peered":"2023-10-06T04:16:56.674138+0000","last_clean":"2023-10-06T04:16:56.674138+0000","last_became_active":"2023-10-06T04:16:56.672433+0000","last_became_peered":"2023-10-06T04:16:56.672433+0000","last_unstale":"2023-10-06T04:16:56.674138+0000","last_undegraded":"2023-10-06T04:16:56.674138+0000","last_fullsized":"2023-10-06T04:16:56.674138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653810+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:56.653810+0000","last_peered":"2023-10-06T04:16:56.653810+0000","last_clean":"2023-10-06T04:16:56.653810+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:56.653810+0000","last_undegraded":"2023-10-06T04:16:56.653810+0000","last_fullsized":"2023-10-06T04:16:56.653810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676608+0000","last_change":"2023-10-06T04:16:56.675176+0000","last_active":"2023-10-06T04:16:56.676608+0000","last_peered":"2023-10-06T04:16:56.676608+0000","last_clean":"2023-10-06T04:16:56.676608+0000","last_became_active":"2023-10-06T04:16:56.674871+0000","last_became_peered":"2023-10-06T04:16:56.674871+0000","last_unstale":"2023-10-06T04:16:56.676608+0000","last_undegraded":"2023-10-06T04:16:56.676608+0000","last_fullsized":"2023-10-06T04:16:56.676608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691464+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:56.691464+0000","last_peered":"2023-10-06T04:16:56.691464+0000","last_clean":"2023-10-06T04:16:56.691464+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:56.691464+0000","last_undegraded":"2023-10-06T04:16:56.691464+0000","last_fullsized":"2023-10-06T04:16:56.691464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666039+0000","last_change":"2023-10-06T04:16:56.664308+0000","last_active":"2023-10-06T04:16:56.666039+0000","last_peered":"2023-10-06T04:16:56.666039+0000","last_clean":"2023-10-06T04:16:56.666039+0000","last_became_active":"2023-10-06T04:16:56.664011+0000","last_became_peered":"2023-10-06T04:16:56.664011+0000","last_unstale":"2023-10-06T04:16:56.666039+0000","last_undegraded":"2023-10-06T04:16:56.666039+0000","last_fullsized":"2023-10-06T04:16:56.666039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:49.601120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663190+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:56.663190+0000","last_peered":"2023-10-06T04:16:56.663190+0000","last_clean":"2023-10-06T04:16:56.663190+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:56.663190+0000","last_undegraded":"2023-10-06T04:16:56.663190+0000","last_fullsized":"2023-10-06T04:16:56.663190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666606+0000","last_change":"2023-10-06T04:16:56.664458+0000","last_active":"2023-10-06T04:16:56.666606+0000","last_peered":"2023-10-06T04:16:56.666606+0000","last_clean":"2023-10-06T04:16:56.666606+0000","last_became_active":"2023-10-06T04:16:56.664213+0000","last_became_peered":"2023-10-06T04:16:56.664213+0000","last_unstale":"2023-10-06T04:16:56.666606+0000","last_undegraded":"2023-10-06T04:16:56.666606+0000","last_fullsized":"2023-10-06T04:16:56.666606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655273+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:56.655273+0000","last_peered":"2023-10-06T04:16:56.655273+0000","last_clean":"2023-10-06T04:16:56.655273+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:56.655273+0000","last_undegraded":"2023-10-06T04:16:56.655273+0000","last_fullsized":"2023-10-06T04:16:56.655273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672175+0000","last_change":"2023-10-06T04:16:56.668413+0000","last_active":"2023-10-06T04:16:56.672175+0000","last_peered":"2023-10-06T04:16:56.672175+0000","last_clean":"2023-10-06T04:16:56.672175+0000","last_became_active":"2023-10-06T04:16:56.668093+0000","last_became_peered":"2023-10-06T04:16:56.668093+0000","last_unstale":"2023-10-06T04:16:56.672175+0000","last_undegraded":"2023-10-06T04:16:56.672175+0000","last_fullsized":"2023-10-06T04:16:56.672175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657650+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:56.657650+0000","last_peered":"2023-10-06T04:16:56.657650+0000","last_clean":"2023-10-06T04:16:56.657650+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:56.657650+0000","last_undegraded":"2023-10-06T04:16:56.657650+0000","last_fullsized":"2023-10-06T04:16:56.657650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673361+0000","last_change":"2023-10-06T04:16:56.671285+0000","last_active":"2023-10-06T04:16:56.673361+0000","last_peered":"2023-10-06T04:16:56.673361+0000","last_clean":"2023-10-06T04:16:56.673361+0000","last_became_active":"2023-10-06T04:16:56.671009+0000","last_became_peered":"2023-10-06T04:16:56.671009+0000","last_unstale":"2023-10-06T04:16:56.673361+0000","last_undegraded":"2023-10-06T04:16:56.673361+0000","last_fullsized":"2023-10-06T04:16:56.673361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658750+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:56.658750+0000","last_peered":"2023-10-06T04:16:56.658750+0000","last_clean":"2023-10-06T04:16:56.658750+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:56.658750+0000","last_undegraded":"2023-10-06T04:16:56.658750+0000","last_fullsized":"2023-10-06T04:16:56.658750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657337+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:56.657337+0000","last_peered":"2023-10-06T04:16:56.657337+0000","last_clean":"2023-10-06T04:16:56.657337+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:56.657337+0000","last_undegraded":"2023-10-06T04:16:56.657337+0000","last_fullsized":"2023-10-06T04:16:56.657337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671795+0000","last_change":"2023-10-06T04:16:56.660763+0000","last_active":"2023-10-06T04:16:56.671795+0000","last_peered":"2023-10-06T04:16:56.671795+0000","last_clean":"2023-10-06T04:16:56.671795+0000","last_became_active":"2023-10-06T04:16:56.660470+0000","last_became_peered":"2023-10-06T04:16:56.660470+0000","last_unstale":"2023-10-06T04:16:56.671795+0000","last_undegraded":"2023-10-06T04:16:56.671795+0000","last_fullsized":"2023-10-06T04:16:56.671795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669999+0000","last_change":"2023-10-06T04:16:56.665106+0000","last_active":"2023-10-06T04:16:56.669999+0000","last_peered":"2023-10-06T04:16:56.669999+0000","last_clean":"2023-10-06T04:16:56.669999+0000","last_became_active":"2023-10-06T04:16:56.664811+0000","last_became_peered":"2023-10-06T04:16:56.664811+0000","last_unstale":"2023-10-06T04:16:56.669999+0000","last_undegraded":"2023-10-06T04:16:56.669999+0000","last_fullsized":"2023-10-06T04:16:56.669999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.652014+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:56.652014+0000","last_peered":"2023-10-06T04:16:56.652014+0000","last_clean":"2023-10-06T04:16:56.652014+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:56.652014+0000","last_undegraded":"2023-10-06T04:16:56.652014+0000","last_fullsized":"2023-10-06T04:16:56.652014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658314+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:56.658314+0000","last_peered":"2023-10-06T04:16:56.658314+0000","last_clean":"2023-10-06T04:16:56.658314+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:56.658314+0000","last_undegraded":"2023-10-06T04:16:56.658314+0000","last_fullsized":"2023-10-06T04:16:56.658314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668964+0000","last_change":"2023-10-06T04:16:56.661671+0000","last_active":"2023-10-06T04:16:56.668964+0000","last_peered":"2023-10-06T04:16:56.668964+0000","last_clean":"2023-10-06T04:16:56.668964+0000","last_became_active":"2023-10-06T04:16:56.660697+0000","last_became_peered":"2023-10-06T04:16:56.660697+0000","last_unstale":"2023-10-06T04:16:56.668964+0000","last_undegraded":"2023-10-06T04:16:56.668964+0000","last_fullsized":"2023-10-06T04:16:56.668964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653351+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:56.653351+0000","last_peered":"2023-10-06T04:16:56.653351+0000","last_clean":"2023-10-06T04:16:56.653351+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:56.653351+0000","last_undegraded":"2023-10-06T04:16:56.653351+0000","last_fullsized":"2023-10-06T04:16:56.653351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660306+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:56.660306+0000","last_peered":"2023-10-06T04:16:56.660306+0000","last_clean":"2023-10-06T04:16:56.660306+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:56.660306+0000","last_undegraded":"2023-10-06T04:16:56.660306+0000","last_fullsized":"2023-10-06T04:16:56.660306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655543+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:56.655543+0000","last_peered":"2023-10-06T04:16:56.655543+0000","last_clean":"2023-10-06T04:16:56.655543+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:56.655543+0000","last_undegraded":"2023-10-06T04:16:56.655543+0000","last_fullsized":"2023-10-06T04:16:56.655543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672541+0000","last_change":"2023-10-06T04:16:56.671575+0000","last_active":"2023-10-06T04:16:56.672541+0000","last_peered":"2023-10-06T04:16:56.672541+0000","last_clean":"2023-10-06T04:16:56.672541+0000","last_became_active":"2023-10-06T04:16:56.671276+0000","last_became_peered":"2023-10-06T04:16:56.671276+0000","last_unstale":"2023-10-06T04:16:56.672541+0000","last_undegraded":"2023-10-06T04:16:56.672541+0000","last_fullsized":"2023-10-06T04:16:56.672541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660411+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:56.660411+0000","last_peered":"2023-10-06T04:16:56.660411+0000","last_clean":"2023-10-06T04:16:56.660411+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:56.660411+0000","last_undegraded":"2023-10-06T04:16:56.660411+0000","last_fullsized":"2023-10-06T04:16:56.660411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664829+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:56.664829+0000","last_peered":"2023-10-06T04:16:56.664829+0000","last_clean":"2023-10-06T04:16:56.664829+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:56.664829+0000","last_undegraded":"2023-10-06T04:16:56.664829+0000","last_fullsized":"2023-10-06T04:16:56.664829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678965+0000","last_change":"2023-10-06T04:16:56.677307+0000","last_active":"2023-10-06T04:16:56.678965+0000","last_peered":"2023-10-06T04:16:56.678965+0000","last_clean":"2023-10-06T04:16:56.678965+0000","last_became_active":"2023-10-06T04:16:56.676460+0000","last_became_peered":"2023-10-06T04:16:56.676460+0000","last_unstale":"2023-10-06T04:16:56.678965+0000","last_undegraded":"2023-10-06T04:16:56.678965+0000","last_fullsized":"2023-10-06T04:16:56.678965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663629+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:56.663629+0000","last_peered":"2023-10-06T04:16:56.663629+0000","last_clean":"2023-10-06T04:16:56.663629+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:56.663629+0000","last_undegraded":"2023-10-06T04:16:56.663629+0000","last_fullsized":"2023-10-06T04:16:56.663629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658864+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:56.658864+0000","last_peered":"2023-10-06T04:16:56.658864+0000","last_clean":"2023-10-06T04:16:56.658864+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:56.658864+0000","last_undegraded":"2023-10-06T04:16:56.658864+0000","last_fullsized":"2023-10-06T04:16:56.658864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676108+0000","last_change":"2023-10-06T04:16:56.669292+0000","last_active":"2023-10-06T04:16:56.676108+0000","last_peered":"2023-10-06T04:16:56.676108+0000","last_clean":"2023-10-06T04:16:56.676108+0000","last_became_active":"2023-10-06T04:16:56.668986+0000","last_became_peered":"2023-10-06T04:16:56.668986+0000","last_unstale":"2023-10-06T04:16:56.676108+0000","last_undegraded":"2023-10-06T04:16:56.676108+0000","last_fullsized":"2023-10-06T04:16:56.676108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692290+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:56.692290+0000","last_peered":"2023-10-06T04:16:56.692290+0000","last_clean":"2023-10-06T04:16:56.692290+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:56.692290+0000","last_undegraded":"2023-10-06T04:16:56.692290+0000","last_fullsized":"2023-10-06T04:16:56.692290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658866+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:56.658866+0000","last_peered":"2023-10-06T04:16:56.658866+0000","last_clean":"2023-10-06T04:16:56.658866+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:56.658866+0000","last_undegraded":"2023-10-06T04:16:56.658866+0000","last_fullsized":"2023-10-06T04:16:56.658866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676714+0000","last_change":"2023-10-06T04:16:56.673874+0000","last_active":"2023-10-06T04:16:56.676714+0000","last_peered":"2023-10-06T04:16:56.676714+0000","last_clean":"2023-10-06T04:16:56.676714+0000","last_became_active":"2023-10-06T04:16:56.673236+0000","last_became_peered":"2023-10-06T04:16:56.673236+0000","last_unstale":"2023-10-06T04:16:56.676714+0000","last_undegraded":"2023-10-06T04:16:56.676714+0000","last_fullsized":"2023-10-06T04:16:56.676714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662103+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:56.662103+0000","last_peered":"2023-10-06T04:16:56.662103+0000","last_clean":"2023-10-06T04:16:56.662103+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:56.662103+0000","last_undegraded":"2023-10-06T04:16:56.662103+0000","last_fullsized":"2023-10-06T04:16:56.662103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T04:16:57.674758+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:57.674758+0000","last_peered":"2023-10-06T04:16:57.674758+0000","last_clean":"2023-10-06T04:16:57.674758+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:57.674758+0000","last_undegraded":"2023-10-06T04:16:57.674758+0000","last_fullsized":"2023-10-06T04:16:57.674758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665712+0000","last_change":"2023-10-06T04:16:56.659978+0000","last_active":"2023-10-06T04:16:56.665712+0000","last_peered":"2023-10-06T04:16:56.665712+0000","last_clean":"2023-10-06T04:16:56.665712+0000","last_became_active":"2023-10-06T04:16:56.659701+0000","last_became_peered":"2023-10-06T04:16:56.659701+0000","last_unstale":"2023-10-06T04:16:56.665712+0000","last_undegraded":"2023-10-06T04:16:56.665712+0000","last_fullsized":"2023-10-06T04:16:56.665712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691318+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:56.691318+0000","last_peered":"2023-10-06T04:16:56.691318+0000","last_clean":"2023-10-06T04:16:56.691318+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:56.691318+0000","last_undegraded":"2023-10-06T04:16:56.691318+0000","last_fullsized":"2023-10-06T04:16:56.691318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673783+0000","last_change":"2023-10-06T04:16:56.666213+0000","last_active":"2023-10-06T04:16:56.673783+0000","last_peered":"2023-10-06T04:16:56.673783+0000","last_clean":"2023-10-06T04:16:56.673783+0000","last_became_active":"2023-10-06T04:16:56.665929+0000","last_became_peered":"2023-10-06T04:16:56.665929+0000","last_unstale":"2023-10-06T04:16:56.673783+0000","last_undegraded":"2023-10-06T04:16:56.673783+0000","last_fullsized":"2023-10-06T04:16:56.673783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691805+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:56.691805+0000","last_peered":"2023-10-06T04:16:56.691805+0000","last_clean":"2023-10-06T04:16:56.691805+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:56.691805+0000","last_undegraded":"2023-10-06T04:16:56.691805+0000","last_fullsized":"2023-10-06T04:16:56.691805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665999+0000","last_change":"2023-10-06T04:16:56.663079+0000","last_active":"2023-10-06T04:16:56.665999+0000","last_peered":"2023-10-06T04:16:56.665999+0000","last_clean":"2023-10-06T04:16:56.665999+0000","last_became_active":"2023-10-06T04:16:56.662838+0000","last_became_peered":"2023-10-06T04:16:56.662838+0000","last_unstale":"2023-10-06T04:16:56.665999+0000","last_undegraded":"2023-10-06T04:16:56.665999+0000","last_fullsized":"2023-10-06T04:16:56.665999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:22.046890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691400+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:56.691400+0000","last_peered":"2023-10-06T04:16:56.691400+0000","last_clean":"2023-10-06T04:16:56.691400+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:56.691400+0000","last_undegraded":"2023-10-06T04:16:56.691400+0000","last_fullsized":"2023-10-06T04:16:56.691400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666210+0000","last_change":"2023-10-06T04:16:56.664312+0000","last_active":"2023-10-06T04:16:56.666210+0000","last_peered":"2023-10-06T04:16:56.666210+0000","last_clean":"2023-10-06T04:16:56.666210+0000","last_became_active":"2023-10-06T04:16:56.664028+0000","last_became_peered":"2023-10-06T04:16:56.664028+0000","last_unstale":"2023-10-06T04:16:56.666210+0000","last_undegraded":"2023-10-06T04:16:56.666210+0000","last_fullsized":"2023-10-06T04:16:56.666210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.688921+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:56.688921+0000","last_peered":"2023-10-06T04:16:56.688921+0000","last_clean":"2023-10-06T04:16:56.688921+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:56.688921+0000","last_undegraded":"2023-10-06T04:16:56.688921+0000","last_fullsized":"2023-10-06T04:16:56.688921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670590+0000","last_change":"2023-10-06T04:16:56.666518+0000","last_active":"2023-10-06T04:16:56.670590+0000","last_peered":"2023-10-06T04:16:56.670590+0000","last_clean":"2023-10-06T04:16:56.670590+0000","last_became_active":"2023-10-06T04:16:56.666210+0000","last_became_peered":"2023-10-06T04:16:56.666210+0000","last_unstale":"2023-10-06T04:16:56.670590+0000","last_undegraded":"2023-10-06T04:16:56.670590+0000","last_fullsized":"2023-10-06T04:16:56.670590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693693+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:56.693693+0000","last_peered":"2023-10-06T04:16:56.693693+0000","last_clean":"2023-10-06T04:16:56.693693+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:56.693693+0000","last_undegraded":"2023-10-06T04:16:56.693693+0000","last_fullsized":"2023-10-06T04:16:56.693693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671474+0000","last_change":"2023-10-06T04:16:56.666522+0000","last_active":"2023-10-06T04:16:56.671474+0000","last_peered":"2023-10-06T04:16:56.671474+0000","last_clean":"2023-10-06T04:16:56.671474+0000","last_became_active":"2023-10-06T04:16:56.666259+0000","last_became_peered":"2023-10-06T04:16:56.666259+0000","last_unstale":"2023-10-06T04:16:56.671474+0000","last_undegraded":"2023-10-06T04:16:56.671474+0000","last_fullsized":"2023-10-06T04:16:56.671474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674341+0000","last_change":"2023-10-06T04:16:56.672889+0000","last_active":"2023-10-06T04:16:56.674341+0000","last_peered":"2023-10-06T04:16:56.674341+0000","last_clean":"2023-10-06T04:16:56.674341+0000","last_became_active":"2023-10-06T04:16:56.672585+0000","last_became_peered":"2023-10-06T04:16:56.672585+0000","last_unstale":"2023-10-06T04:16:56.674341+0000","last_undegraded":"2023-10-06T04:16:56.674341+0000","last_fullsized":"2023-10-06T04:16:56.674341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676761+0000","last_change":"2023-10-06T04:16:56.671951+0000","last_active":"2023-10-06T04:16:56.676761+0000","last_peered":"2023-10-06T04:16:56.676761+0000","last_clean":"2023-10-06T04:16:56.676761+0000","last_became_active":"2023-10-06T04:16:56.671467+0000","last_became_peered":"2023-10-06T04:16:56.671467+0000","last_unstale":"2023-10-06T04:16:56.676761+0000","last_undegraded":"2023-10-06T04:16:56.676761+0000","last_fullsized":"2023-10-06T04:16:56.676761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672197+0000","last_change":"2023-10-06T04:16:56.668427+0000","last_active":"2023-10-06T04:16:56.672197+0000","last_peered":"2023-10-06T04:16:56.672197+0000","last_clean":"2023-10-06T04:16:56.672197+0000","last_became_active":"2023-10-06T04:16:56.668119+0000","last_became_peered":"2023-10-06T04:16:56.668119+0000","last_unstale":"2023-10-06T04:16:56.672197+0000","last_undegraded":"2023-10-06T04:16:56.672197+0000","last_fullsized":"2023-10-06T04:16:56.672197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676893+0000","last_change":"2023-10-06T04:16:56.670079+0000","last_active":"2023-10-06T04:16:56.676893+0000","last_peered":"2023-10-06T04:16:56.676893+0000","last_clean":"2023-10-06T04:16:56.676893+0000","last_became_active":"2023-10-06T04:16:56.669692+0000","last_became_peered":"2023-10-06T04:16:56.669692+0000","last_unstale":"2023-10-06T04:16:56.676893+0000","last_undegraded":"2023-10-06T04:16:56.676893+0000","last_fullsized":"2023-10-06T04:16:56.676893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671532+0000","last_change":"2023-10-06T04:16:56.669243+0000","last_active":"2023-10-06T04:16:56.671532+0000","last_peered":"2023-10-06T04:16:56.671532+0000","last_clean":"2023-10-06T04:16:56.671532+0000","last_became_active":"2023-10-06T04:16:56.668889+0000","last_became_peered":"2023-10-06T04:16:56.668889+0000","last_unstale":"2023-10-06T04:16:56.671532+0000","last_undegraded":"2023-10-06T04:16:56.671532+0000","last_fullsized":"2023-10-06T04:16:56.671532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":681439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":680241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":245760,"data_stored":89409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":90911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":89943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:08.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:08.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.448+0000 7fe00ca57700 1 Processor -- start 2023-10-06T04:17:08.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.448+0000 7fe00ca57700 1 -- start start 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.449+0000 7fe00ca57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 0x7fe0080ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.449+0000 7fe00ca57700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080ae9f0 con 0x7fe0080b5e30 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.449+0000 7fe00ca57700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080adde0 con 0x7fe0080b6200 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.449+0000 7fe00ca57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080ae0c0 con 0x7fe00815dc70 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0080b5e30 0x7fe00815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58486/0 (socket says 172.21.15.37:58486) 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00659c700 1 -- 172.21.15.37:0/474297717 learned_addr learned my addr 172.21.15.37:0/474297717 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe005d9b700 1 --2- 172.21.15.37:0/474297717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 0x7fe0080ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762067238 0 0) 0x7fe0080ae9f0 con 0x7fe0080b5e30 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff4003570 con 0x7fe0080b5e30 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723385758 0 0) 0x7fe0080adde0 con 0x7fe0080b6200 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0080ae9f0 con 0x7fe0080b6200 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871896187 0 0) 0x7fdff4003570 con 0x7fe0080b5e30 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe005d9b700 1 -- 172.21.15.37:0/474297717 >> v1:172.21.15.83:6789/0 conn(0x7fe0080b6200 legacy=0x7fe0080ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe005d9b700 1 -- 172.21.15.37:0/474297717 >> v1:172.21.15.37:6789/0 conn(0x7fe0080b5e30 legacy=0x7fe00815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe005d9b700 1 -- 172.21.15.37:0/474297717 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080ae3a0 con 0x7fe00815dc70 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe005d9b700 1 --2- 172.21.15.37:0/474297717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 0x7fe0080ad0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009910 tx=0x7fdff00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c16b7971e85b1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000017f0 con 0x7fe00815dc70 2023-10-06T04:17:08.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0011420 con 0x7fe00815dc70 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.450+0000 7fe00559a700 1 -- 172.21.15.37:0/474297717 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00117a0 con 0x7fe00815dc70 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 -- 172.21.15.37:0/474297717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 msgr2=0x7fe0080ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 --2- 172.21.15.37:0/474297717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 0x7fe0080ad0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009910 tx=0x7fdff00091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 -- 172.21.15.37:0/474297717 shutdown_connections 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 --2- 172.21.15.37:0/474297717 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe00815dc70 0x7fe0080ad0f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 -- 172.21.15.37:0/474297717 >> 172.21.15.37:0/474297717 conn(0x7fe008099a10 msgr2=0x7fe00806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 -- 172.21.15.37:0/474297717 shutdown_connections 2023-10-06T04:17:08.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.451+0000 7fe00ca57700 1 -- 172.21.15.37:0/474297717 wait complete. 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.452+0000 7fe00ca57700 1 Processor -- start 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.452+0000 7fe00ca57700 1 -- start start 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0080b5e30 0x7fe0080c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0080b6200 0x7fe0080c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00809cfb0 con 0x7fe00815dc70 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00809d290 con 0x7fe0080b6200 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00ca57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00809d570 con 0x7fe0080b5e30 2023-10-06T04:17:08.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40000/0 (socket says 172.21.15.37:40000) 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 -- 172.21.15.37:0/2859276512 learned_addr learned my addr 172.21.15.37:0/2859276512 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe005d9b700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0080b6200 0x7fe0080c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe00659c700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0080b5e30 0x7fe0080c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 -- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0080b5e30 msgr2=0x7fe0080c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0080b5e30 0x7fe0080c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 -- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0080b6200 msgr2=0x7fe0080c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0080b6200 0x7fe0080c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 -- 172.21.15.37:0/2859276512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009420 con 0x7fe00815dc70 2023-10-06T04:17:08.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.453+0000 7fe006d9d700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c560 tx=0x7fdff8007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.454+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8011590 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.454+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff80116f0 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.454+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00809d850 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.454+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8011a90 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.454+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0080c6600 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.455+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080c67f0 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.455+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdff801c460 con 0x7fe00815dc70 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.455+0000 7fdffe7fc700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.456+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdff8084270 con 0x7fe00815dc70 2023-10-06T04:17:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.456+0000 7fe00659c700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.456+0000 7fe00659c700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 0x7fdfe80693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe000001fd0 tx=0x7fe000000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.460+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdff8051380 con 0x7fe00815dc70 2023-10-06T04:17:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.649+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0080b2f90 con 0x7fdfe8066f30 2023-10-06T04:17:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.657+0000 7fdffe7fc700 1 -- 172.21.15.37:0/2859276512 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286599 (secure 0 0 0) 0x7fe0080b2f90 con 0x7fdfe8066f30 2023-10-06T04:17:08.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.660+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 msgr2=0x7fdfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.660+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 0x7fdfe80693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe000001fd0 tx=0x7fe000000f40 comp rx=0 tx=0).stop 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.660+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 msgr2=0x7fe008156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.660+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c560 tx=0x7fdff8007d50 comp rx=0 tx=0).stop 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 shutdown_connections 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe00815dc70 0x7fe008156190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0080b5e30 0x7fe0080c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 --2- 172.21.15.37:0/2859276512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0080b6200 0x7fe0080c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 >> 172.21.15.37:0/2859276512 conn(0x7fe008099a10 msgr2=0x7fe0080ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 shutdown_connections 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.661+0000 7fe00ca57700 1 -- 172.21.15.37:0/2859276512 wait complete. 2023-10-06T04:17:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:08.675 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-10-06T04:17:07.485533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381416,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593304,"statfs":{"total":773094113280,"available":770655543296,"internally_reserved":0,"allocated":3186688,"data_stored":1899900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675807+0000","last_change":"2023-10-06T04:16:56.668658+0000","last_active":"2023-10-06T04:16:56.675807+0000","last_peered":"2023-10-06T04:16:56.675807+0000","last_clean":"2023-10-06T04:16:56.675807+0000","last_became_active":"2023-10-06T04:16:56.668367+0000","last_became_peered":"2023-10-06T04:16:56.668367+0000","last_unstale":"2023-10-06T04:16:56.675807+0000","last_undegraded":"2023-10-06T04:16:56.675807+0000","last_fullsized":"2023-10-06T04:16:56.675807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.968140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668025+0000","last_change":"2023-10-06T04:16:56.662736+0000","last_active":"2023-10-06T04:16:56.668025+0000","last_peered":"2023-10-06T04:16:56.668025+0000","last_clean":"2023-10-06T04:16:56.668025+0000","last_became_active":"2023-10-06T04:16:56.662469+0000","last_became_peered":"2023-10-06T04:16:56.662469+0000","last_unstale":"2023-10-06T04:16:56.668025+0000","last_undegraded":"2023-10-06T04:16:56.668025+0000","last_fullsized":"2023-10-06T04:16:56.668025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672509+0000","last_change":"2023-10-06T04:16:56.670653+0000","last_active":"2023-10-06T04:16:56.672509+0000","last_peered":"2023-10-06T04:16:56.672509+0000","last_clean":"2023-10-06T04:16:56.672509+0000","last_became_active":"2023-10-06T04:16:56.670416+0000","last_became_peered":"2023-10-06T04:16:56.670416+0000","last_unstale":"2023-10-06T04:16:56.672509+0000","last_undegraded":"2023-10-06T04:16:56.672509+0000","last_fullsized":"2023-10-06T04:16:56.672509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:11.137952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672609+0000","last_change":"2023-10-06T04:16:56.669774+0000","last_active":"2023-10-06T04:16:56.672609+0000","last_peered":"2023-10-06T04:16:56.672609+0000","last_clean":"2023-10-06T04:16:56.672609+0000","last_became_active":"2023-10-06T04:16:56.669493+0000","last_became_peered":"2023-10-06T04:16:56.669493+0000","last_unstale":"2023-10-06T04:16:56.672609+0000","last_undegraded":"2023-10-06T04:16:56.672609+0000","last_fullsized":"2023-10-06T04:16:56.672609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:37.002759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676488+0000","last_change":"2023-10-06T04:16:56.672513+0000","last_active":"2023-10-06T04:16:56.676488+0000","last_peered":"2023-10-06T04:16:56.676488+0000","last_clean":"2023-10-06T04:16:56.676488+0000","last_became_active":"2023-10-06T04:16:56.672282+0000","last_became_peered":"2023-10-06T04:16:56.672282+0000","last_unstale":"2023-10-06T04:16:56.676488+0000","last_undegraded":"2023-10-06T04:16:56.676488+0000","last_fullsized":"2023-10-06T04:16:56.676488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.675009+0000","last_change":"2023-10-06T04:16:56.674519+0000","last_active":"2023-10-06T04:16:56.675009+0000","last_peered":"2023-10-06T04:16:56.675009+0000","last_clean":"2023-10-06T04:16:56.675009+0000","last_became_active":"2023-10-06T04:16:56.674243+0000","last_became_peered":"2023-10-06T04:16:56.674243+0000","last_unstale":"2023-10-06T04:16:56.675009+0000","last_undegraded":"2023-10-06T04:16:56.675009+0000","last_fullsized":"2023-10-06T04:16:56.675009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:52.285904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673077+0000","last_change":"2023-10-06T04:16:56.670881+0000","last_active":"2023-10-06T04:16:56.673077+0000","last_peered":"2023-10-06T04:16:56.673077+0000","last_clean":"2023-10-06T04:16:56.673077+0000","last_became_active":"2023-10-06T04:16:56.670084+0000","last_became_peered":"2023-10-06T04:16:56.670084+0000","last_unstale":"2023-10-06T04:16:56.673077+0000","last_undegraded":"2023-10-06T04:16:56.673077+0000","last_fullsized":"2023-10-06T04:16:56.673077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664646+0000","last_change":"2023-10-06T04:16:56.659682+0000","last_active":"2023-10-06T04:16:56.664646+0000","last_peered":"2023-10-06T04:16:56.664646+0000","last_clean":"2023-10-06T04:16:56.664646+0000","last_became_active":"2023-10-06T04:16:56.659343+0000","last_became_peered":"2023-10-06T04:16:56.659343+0000","last_unstale":"2023-10-06T04:16:56.664646+0000","last_undegraded":"2023-10-06T04:16:56.664646+0000","last_fullsized":"2023-10-06T04:16:56.664646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678987+0000","last_change":"2023-10-06T04:16:56.677372+0000","last_active":"2023-10-06T04:16:56.678987+0000","last_peered":"2023-10-06T04:16:56.678987+0000","last_clean":"2023-10-06T04:16:56.678987+0000","last_became_active":"2023-10-06T04:16:56.677105+0000","last_became_peered":"2023-10-06T04:16:56.677105+0000","last_unstale":"2023-10-06T04:16:56.678987+0000","last_undegraded":"2023-10-06T04:16:56.678987+0000","last_fullsized":"2023-10-06T04:16:56.678987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678358+0000","last_change":"2023-10-06T04:16:56.677091+0000","last_active":"2023-10-06T04:16:56.678358+0000","last_peered":"2023-10-06T04:16:56.678358+0000","last_clean":"2023-10-06T04:16:56.678358+0000","last_became_active":"2023-10-06T04:16:56.676847+0000","last_became_peered":"2023-10-06T04:16:56.676847+0000","last_unstale":"2023-10-06T04:16:56.678358+0000","last_undegraded":"2023-10-06T04:16:56.678358+0000","last_fullsized":"2023-10-06T04:16:56.678358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665750+0000","last_change":"2023-10-06T04:16:56.662284+0000","last_active":"2023-10-06T04:16:56.665750+0000","last_peered":"2023-10-06T04:16:56.665750+0000","last_clean":"2023-10-06T04:16:56.665750+0000","last_became_active":"2023-10-06T04:16:56.662013+0000","last_became_peered":"2023-10-06T04:16:56.662013+0000","last_unstale":"2023-10-06T04:16:56.665750+0000","last_undegraded":"2023-10-06T04:16:56.665750+0000","last_fullsized":"2023-10-06T04:16:56.665750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662752+0000","last_change":"2023-10-06T04:16:56.659881+0000","last_active":"2023-10-06T04:16:56.662752+0000","last_peered":"2023-10-06T04:16:56.662752+0000","last_clean":"2023-10-06T04:16:56.662752+0000","last_became_active":"2023-10-06T04:16:56.659565+0000","last_became_peered":"2023-10-06T04:16:56.659565+0000","last_unstale":"2023-10-06T04:16:56.662752+0000","last_undegraded":"2023-10-06T04:16:56.662752+0000","last_fullsized":"2023-10-06T04:16:56.662752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.667677+0000","last_change":"2023-10-06T04:16:56.662578+0000","last_active":"2023-10-06T04:16:56.667677+0000","last_peered":"2023-10-06T04:16:56.667677+0000","last_clean":"2023-10-06T04:16:56.667677+0000","last_became_active":"2023-10-06T04:16:56.662288+0000","last_became_peered":"2023-10-06T04:16:56.662288+0000","last_unstale":"2023-10-06T04:16:56.667677+0000","last_undegraded":"2023-10-06T04:16:56.667677+0000","last_fullsized":"2023-10-06T04:16:56.667677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:00.252722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.659914+0000","last_change":"2023-10-06T04:16:56.659075+0000","last_active":"2023-10-06T04:16:56.659914+0000","last_peered":"2023-10-06T04:16:56.659914+0000","last_clean":"2023-10-06T04:16:56.659914+0000","last_became_active":"2023-10-06T04:16:56.658630+0000","last_became_peered":"2023-10-06T04:16:56.658630+0000","last_unstale":"2023-10-06T04:16:56.659914+0000","last_undegraded":"2023-10-06T04:16:56.659914+0000","last_fullsized":"2023-10-06T04:16:56.659914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672766+0000","last_change":"2023-10-06T04:16:56.670918+0000","last_active":"2023-10-06T04:16:56.672766+0000","last_peered":"2023-10-06T04:16:56.672766+0000","last_clean":"2023-10-06T04:16:56.672766+0000","last_became_active":"2023-10-06T04:16:56.670638+0000","last_became_peered":"2023-10-06T04:16:56.670638+0000","last_unstale":"2023-10-06T04:16:56.672766+0000","last_undegraded":"2023-10-06T04:16:56.672766+0000","last_fullsized":"2023-10-06T04:16:56.672766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672225+0000","last_change":"2023-10-06T04:16:56.670135+0000","last_active":"2023-10-06T04:16:56.672225+0000","last_peered":"2023-10-06T04:16:56.672225+0000","last_clean":"2023-10-06T04:16:56.672225+0000","last_became_active":"2023-10-06T04:16:56.669855+0000","last_became_peered":"2023-10-06T04:16:56.669855+0000","last_unstale":"2023-10-06T04:16:56.672225+0000","last_undegraded":"2023-10-06T04:16:56.672225+0000","last_fullsized":"2023-10-06T04:16:56.672225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:49.318756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676508+0000","last_change":"2023-10-06T04:16:56.673235+0000","last_active":"2023-10-06T04:16:56.676508+0000","last_peered":"2023-10-06T04:16:56.676508+0000","last_clean":"2023-10-06T04:16:56.676508+0000","last_became_active":"2023-10-06T04:16:56.672853+0000","last_became_peered":"2023-10-06T04:16:56.672853+0000","last_unstale":"2023-10-06T04:16:56.676508+0000","last_undegraded":"2023-10-06T04:16:56.676508+0000","last_fullsized":"2023-10-06T04:16:56.676508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666241+0000","last_change":"2023-10-06T04:16:56.663344+0000","last_active":"2023-10-06T04:16:56.666241+0000","last_peered":"2023-10-06T04:16:56.666241+0000","last_clean":"2023-10-06T04:16:56.666241+0000","last_became_active":"2023-10-06T04:16:56.663082+0000","last_became_peered":"2023-10-06T04:16:56.663082+0000","last_unstale":"2023-10-06T04:16:56.666241+0000","last_undegraded":"2023-10-06T04:16:56.666241+0000","last_fullsized":"2023-10-06T04:16:56.666241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:52.653960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671682+0000","last_change":"2023-10-06T04:16:56.667309+0000","last_active":"2023-10-06T04:16:56.671682+0000","last_peered":"2023-10-06T04:16:56.671682+0000","last_clean":"2023-10-06T04:16:56.671682+0000","last_became_active":"2023-10-06T04:16:56.666994+0000","last_became_peered":"2023-10-06T04:16:56.666994+0000","last_unstale":"2023-10-06T04:16:56.671682+0000","last_undegraded":"2023-10-06T04:16:56.671682+0000","last_fullsized":"2023-10-06T04:16:56.671682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:17.448867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671578+0000","last_change":"2023-10-06T04:16:56.666711+0000","last_active":"2023-10-06T04:16:56.671578+0000","last_peered":"2023-10-06T04:16:56.671578+0000","last_clean":"2023-10-06T04:16:56.671578+0000","last_became_active":"2023-10-06T04:16:56.666304+0000","last_became_peered":"2023-10-06T04:16:56.666304+0000","last_unstale":"2023-10-06T04:16:56.671578+0000","last_undegraded":"2023-10-06T04:16:56.671578+0000","last_fullsized":"2023-10-06T04:16:56.671578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:42.947434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673120+0000","last_change":"2023-10-06T04:16:56.671995+0000","last_active":"2023-10-06T04:16:56.673120+0000","last_peered":"2023-10-06T04:16:56.673120+0000","last_clean":"2023-10-06T04:16:56.673120+0000","last_became_active":"2023-10-06T04:16:56.671358+0000","last_became_peered":"2023-10-06T04:16:56.671358+0000","last_unstale":"2023-10-06T04:16:56.673120+0000","last_undegraded":"2023-10-06T04:16:56.673120+0000","last_fullsized":"2023-10-06T04:16:56.673120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676631+0000","last_change":"2023-10-06T04:16:56.674623+0000","last_active":"2023-10-06T04:16:56.676631+0000","last_peered":"2023-10-06T04:16:56.676631+0000","last_clean":"2023-10-06T04:16:56.676631+0000","last_became_active":"2023-10-06T04:16:56.674251+0000","last_became_peered":"2023-10-06T04:16:56.674251+0000","last_unstale":"2023-10-06T04:16:56.676631+0000","last_undegraded":"2023-10-06T04:16:56.676631+0000","last_fullsized":"2023-10-06T04:16:56.676631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676774+0000","last_change":"2023-10-06T04:16:56.672200+0000","last_active":"2023-10-06T04:16:56.676774+0000","last_peered":"2023-10-06T04:16:56.676774+0000","last_clean":"2023-10-06T04:16:56.676774+0000","last_became_active":"2023-10-06T04:16:56.671885+0000","last_became_peered":"2023-10-06T04:16:56.671885+0000","last_unstale":"2023-10-06T04:16:56.676774+0000","last_undegraded":"2023-10-06T04:16:56.676774+0000","last_fullsized":"2023-10-06T04:16:56.676774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672217+0000","last_change":"2023-10-06T04:16:56.669907+0000","last_active":"2023-10-06T04:16:56.672217+0000","last_peered":"2023-10-06T04:16:56.672217+0000","last_clean":"2023-10-06T04:16:56.672217+0000","last_became_active":"2023-10-06T04:16:56.669630+0000","last_became_peered":"2023-10-06T04:16:56.669630+0000","last_unstale":"2023-10-06T04:16:56.672217+0000","last_undegraded":"2023-10-06T04:16:56.672217+0000","last_fullsized":"2023-10-06T04:16:56.672217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671424+0000","last_change":"2023-10-06T04:16:56.667673+0000","last_active":"2023-10-06T04:16:56.671424+0000","last_peered":"2023-10-06T04:16:56.671424+0000","last_clean":"2023-10-06T04:16:56.671424+0000","last_became_active":"2023-10-06T04:16:56.667408+0000","last_became_peered":"2023-10-06T04:16:56.667408+0000","last_unstale":"2023-10-06T04:16:56.671424+0000","last_undegraded":"2023-10-06T04:16:56.671424+0000","last_fullsized":"2023-10-06T04:16:56.671424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669519+0000","last_change":"2023-10-06T04:16:56.665187+0000","last_active":"2023-10-06T04:16:56.669519+0000","last_peered":"2023-10-06T04:16:56.669519+0000","last_clean":"2023-10-06T04:16:56.669519+0000","last_became_active":"2023-10-06T04:16:56.664852+0000","last_became_peered":"2023-10-06T04:16:56.664852+0000","last_unstale":"2023-10-06T04:16:56.669519+0000","last_undegraded":"2023-10-06T04:16:56.669519+0000","last_fullsized":"2023-10-06T04:16:56.669519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669427+0000","last_change":"2023-10-06T04:16:56.665892+0000","last_active":"2023-10-06T04:16:56.669427+0000","last_peered":"2023-10-06T04:16:56.669427+0000","last_clean":"2023-10-06T04:16:56.669427+0000","last_became_active":"2023-10-06T04:16:56.665587+0000","last_became_peered":"2023-10-06T04:16:56.665587+0000","last_unstale":"2023-10-06T04:16:56.669427+0000","last_undegraded":"2023-10-06T04:16:56.669427+0000","last_fullsized":"2023-10-06T04:16:56.669427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.690846+0000","last_change":"2023-10-06T04:16:55.648135+0000","last_active":"2023-10-06T04:16:56.690846+0000","last_peered":"2023-10-06T04:16:56.690846+0000","last_clean":"2023-10-06T04:16:56.690846+0000","last_became_active":"2023-10-06T04:16:55.647627+0000","last_became_peered":"2023-10-06T04:16:55.647627+0000","last_unstale":"2023-10-06T04:16:56.690846+0000","last_undegraded":"2023-10-06T04:16:56.690846+0000","last_fullsized":"2023-10-06T04:16:56.690846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676137+0000","last_change":"2023-10-06T04:16:56.669519+0000","last_active":"2023-10-06T04:16:56.676137+0000","last_peered":"2023-10-06T04:16:56.676137+0000","last_clean":"2023-10-06T04:16:56.676137+0000","last_became_active":"2023-10-06T04:16:56.669197+0000","last_became_peered":"2023-10-06T04:16:56.669197+0000","last_unstale":"2023-10-06T04:16:56.676137+0000","last_undegraded":"2023-10-06T04:16:56.676137+0000","last_fullsized":"2023-10-06T04:16:56.676137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658364+0000","last_change":"2023-10-06T04:16:55.639342+0000","last_active":"2023-10-06T04:16:56.658364+0000","last_peered":"2023-10-06T04:16:56.658364+0000","last_clean":"2023-10-06T04:16:56.658364+0000","last_became_active":"2023-10-06T04:16:55.639145+0000","last_became_peered":"2023-10-06T04:16:55.639145+0000","last_unstale":"2023-10-06T04:16:56.658364+0000","last_undegraded":"2023-10-06T04:16:56.658364+0000","last_fullsized":"2023-10-06T04:16:56.658364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677416+0000","last_change":"2023-10-06T04:16:56.673577+0000","last_active":"2023-10-06T04:16:56.677416+0000","last_peered":"2023-10-06T04:16:56.677416+0000","last_clean":"2023-10-06T04:16:56.677416+0000","last_became_active":"2023-10-06T04:16:56.672105+0000","last_became_peered":"2023-10-06T04:16:56.672105+0000","last_unstale":"2023-10-06T04:16:56.677416+0000","last_undegraded":"2023-10-06T04:16:56.677416+0000","last_fullsized":"2023-10-06T04:16:56.677416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657761+0000","last_change":"2023-10-06T04:16:55.650734+0000","last_active":"2023-10-06T04:16:56.657761+0000","last_peered":"2023-10-06T04:16:56.657761+0000","last_clean":"2023-10-06T04:16:56.657761+0000","last_became_active":"2023-10-06T04:16:55.650436+0000","last_became_peered":"2023-10-06T04:16:55.650436+0000","last_unstale":"2023-10-06T04:16:56.657761+0000","last_undegraded":"2023-10-06T04:16:56.657761+0000","last_fullsized":"2023-10-06T04:16:56.657761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672585+0000","last_change":"2023-10-06T04:16:56.669053+0000","last_active":"2023-10-06T04:16:56.672585+0000","last_peered":"2023-10-06T04:16:56.672585+0000","last_clean":"2023-10-06T04:16:56.672585+0000","last_became_active":"2023-10-06T04:16:56.668550+0000","last_became_peered":"2023-10-06T04:16:56.668550+0000","last_unstale":"2023-10-06T04:16:56.672585+0000","last_undegraded":"2023-10-06T04:16:56.672585+0000","last_fullsized":"2023-10-06T04:16:56.672585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:09.180448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663592+0000","last_change":"2023-10-06T04:16:55.654519+0000","last_active":"2023-10-06T04:16:56.663592+0000","last_peered":"2023-10-06T04:16:56.663592+0000","last_clean":"2023-10-06T04:16:56.663592+0000","last_became_active":"2023-10-06T04:16:55.654304+0000","last_became_peered":"2023-10-06T04:16:55.654304+0000","last_unstale":"2023-10-06T04:16:56.663592+0000","last_undegraded":"2023-10-06T04:16:56.663592+0000","last_fullsized":"2023-10-06T04:16:56.663592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676739+0000","last_change":"2023-10-06T04:16:56.673953+0000","last_active":"2023-10-06T04:16:56.676739+0000","last_peered":"2023-10-06T04:16:56.676739+0000","last_clean":"2023-10-06T04:16:56.676739+0000","last_became_active":"2023-10-06T04:16:56.672796+0000","last_became_peered":"2023-10-06T04:16:56.672796+0000","last_unstale":"2023-10-06T04:16:56.676739+0000","last_undegraded":"2023-10-06T04:16:56.676739+0000","last_fullsized":"2023-10-06T04:16:56.676739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655148+0000","last_change":"2023-10-06T04:16:55.647827+0000","last_active":"2023-10-06T04:16:56.655148+0000","last_peered":"2023-10-06T04:16:56.655148+0000","last_clean":"2023-10-06T04:16:56.655148+0000","last_became_active":"2023-10-06T04:16:55.647504+0000","last_became_peered":"2023-10-06T04:16:55.647504+0000","last_unstale":"2023-10-06T04:16:56.655148+0000","last_undegraded":"2023-10-06T04:16:56.655148+0000","last_fullsized":"2023-10-06T04:16:56.655148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676749+0000","last_change":"2023-10-06T04:16:56.671605+0000","last_active":"2023-10-06T04:16:56.676749+0000","last_peered":"2023-10-06T04:16:56.676749+0000","last_clean":"2023-10-06T04:16:56.676749+0000","last_became_active":"2023-10-06T04:16:56.670359+0000","last_became_peered":"2023-10-06T04:16:56.670359+0000","last_unstale":"2023-10-06T04:16:56.676749+0000","last_undegraded":"2023-10-06T04:16:56.676749+0000","last_fullsized":"2023-10-06T04:16:56.676749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694597+0000","last_change":"2023-10-06T04:16:55.649098+0000","last_active":"2023-10-06T04:16:56.694597+0000","last_peered":"2023-10-06T04:16:56.694597+0000","last_clean":"2023-10-06T04:16:56.694597+0000","last_became_active":"2023-10-06T04:16:55.648783+0000","last_became_peered":"2023-10-06T04:16:55.648783+0000","last_unstale":"2023-10-06T04:16:56.694597+0000","last_undegraded":"2023-10-06T04:16:56.694597+0000","last_fullsized":"2023-10-06T04:16:56.694597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671837+0000","last_change":"2023-10-06T04:16:56.666797+0000","last_active":"2023-10-06T04:16:56.671837+0000","last_peered":"2023-10-06T04:16:56.671837+0000","last_clean":"2023-10-06T04:16:56.671837+0000","last_became_active":"2023-10-06T04:16:56.666505+0000","last_became_peered":"2023-10-06T04:16:56.666505+0000","last_unstale":"2023-10-06T04:16:56.671837+0000","last_undegraded":"2023-10-06T04:16:56.671837+0000","last_fullsized":"2023-10-06T04:16:56.671837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.694444+0000","last_change":"2023-10-06T04:16:55.654573+0000","last_active":"2023-10-06T04:16:56.694444+0000","last_peered":"2023-10-06T04:16:56.694444+0000","last_clean":"2023-10-06T04:16:56.694444+0000","last_became_active":"2023-10-06T04:16:55.654048+0000","last_became_peered":"2023-10-06T04:16:55.654048+0000","last_unstale":"2023-10-06T04:16:56.694444+0000","last_undegraded":"2023-10-06T04:16:56.694444+0000","last_fullsized":"2023-10-06T04:16:56.694444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672149+0000","last_change":"2023-10-06T04:16:56.668378+0000","last_active":"2023-10-06T04:16:56.672149+0000","last_peered":"2023-10-06T04:16:56.672149+0000","last_clean":"2023-10-06T04:16:56.672149+0000","last_became_active":"2023-10-06T04:16:56.668083+0000","last_became_peered":"2023-10-06T04:16:56.668083+0000","last_unstale":"2023-10-06T04:16:56.672149+0000","last_undegraded":"2023-10-06T04:16:56.672149+0000","last_fullsized":"2023-10-06T04:16:56.672149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:03.661141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692795+0000","last_change":"2023-10-06T04:16:55.655088+0000","last_active":"2023-10-06T04:16:56.692795+0000","last_peered":"2023-10-06T04:16:56.692795+0000","last_clean":"2023-10-06T04:16:56.692795+0000","last_became_active":"2023-10-06T04:16:55.654796+0000","last_became_peered":"2023-10-06T04:16:55.654796+0000","last_unstale":"2023-10-06T04:16:56.692795+0000","last_undegraded":"2023-10-06T04:16:56.692795+0000","last_fullsized":"2023-10-06T04:16:56.692795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676685+0000","last_change":"2023-10-06T04:16:56.671592+0000","last_active":"2023-10-06T04:16:56.676685+0000","last_peered":"2023-10-06T04:16:56.676685+0000","last_clean":"2023-10-06T04:16:56.676685+0000","last_became_active":"2023-10-06T04:16:56.671299+0000","last_became_peered":"2023-10-06T04:16:56.671299+0000","last_unstale":"2023-10-06T04:16:56.676685+0000","last_undegraded":"2023-10-06T04:16:56.676685+0000","last_fullsized":"2023-10-06T04:16:56.676685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:19.448237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668158+0000","last_change":"2023-10-06T04:16:55.650429+0000","last_active":"2023-10-06T04:16:56.668158+0000","last_peered":"2023-10-06T04:16:56.668158+0000","last_clean":"2023-10-06T04:16:56.668158+0000","last_became_active":"2023-10-06T04:16:55.649783+0000","last_became_peered":"2023-10-06T04:16:55.649783+0000","last_unstale":"2023-10-06T04:16:56.668158+0000","last_undegraded":"2023-10-06T04:16:56.668158+0000","last_fullsized":"2023-10-06T04:16:56.668158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669445+0000","last_change":"2023-10-06T04:16:56.665896+0000","last_active":"2023-10-06T04:16:56.669445+0000","last_peered":"2023-10-06T04:16:56.669445+0000","last_clean":"2023-10-06T04:16:56.669445+0000","last_became_active":"2023-10-06T04:16:56.665600+0000","last_became_peered":"2023-10-06T04:16:56.665600+0000","last_unstale":"2023-10-06T04:16:56.669445+0000","last_undegraded":"2023-10-06T04:16:56.669445+0000","last_fullsized":"2023-10-06T04:16:56.669445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662564+0000","last_change":"2023-10-06T04:16:55.655616+0000","last_active":"2023-10-06T04:16:56.662564+0000","last_peered":"2023-10-06T04:16:56.662564+0000","last_clean":"2023-10-06T04:16:56.662564+0000","last_became_active":"2023-10-06T04:16:55.655341+0000","last_became_peered":"2023-10-06T04:16:55.655341+0000","last_unstale":"2023-10-06T04:16:56.662564+0000","last_undegraded":"2023-10-06T04:16:56.662564+0000","last_fullsized":"2023-10-06T04:16:56.662564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.677435+0000","last_change":"2023-10-06T04:16:56.673632+0000","last_active":"2023-10-06T04:16:56.677435+0000","last_peered":"2023-10-06T04:16:56.677435+0000","last_clean":"2023-10-06T04:16:56.677435+0000","last_became_active":"2023-10-06T04:16:56.673351+0000","last_became_peered":"2023-10-06T04:16:56.673351+0000","last_unstale":"2023-10-06T04:16:56.677435+0000","last_undegraded":"2023-10-06T04:16:56.677435+0000","last_fullsized":"2023-10-06T04:16:56.677435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.695221+0000","last_change":"2023-10-06T04:16:55.652432+0000","last_active":"2023-10-06T04:16:56.695221+0000","last_peered":"2023-10-06T04:16:56.695221+0000","last_clean":"2023-10-06T04:16:56.695221+0000","last_became_active":"2023-10-06T04:16:55.652160+0000","last_became_peered":"2023-10-06T04:16:55.652160+0000","last_unstale":"2023-10-06T04:16:56.695221+0000","last_undegraded":"2023-10-06T04:16:56.695221+0000","last_fullsized":"2023-10-06T04:16:56.695221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:21.673060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676351+0000","last_change":"2023-10-06T04:16:56.670186+0000","last_active":"2023-10-06T04:16:56.676351+0000","last_peered":"2023-10-06T04:16:56.676351+0000","last_clean":"2023-10-06T04:16:56.676351+0000","last_became_active":"2023-10-06T04:16:56.669792+0000","last_became_peered":"2023-10-06T04:16:56.669792+0000","last_unstale":"2023-10-06T04:16:56.676351+0000","last_undegraded":"2023-10-06T04:16:56.676351+0000","last_fullsized":"2023-10-06T04:16:56.676351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692671+0000","last_change":"2023-10-06T04:16:55.649831+0000","last_active":"2023-10-06T04:16:56.692671+0000","last_peered":"2023-10-06T04:16:56.692671+0000","last_clean":"2023-10-06T04:16:56.692671+0000","last_became_active":"2023-10-06T04:16:55.649446+0000","last_became_peered":"2023-10-06T04:16:55.649446+0000","last_unstale":"2023-10-06T04:16:56.692671+0000","last_undegraded":"2023-10-06T04:16:56.692671+0000","last_fullsized":"2023-10-06T04:16:56.692671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:54.653002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669397+0000","last_change":"2023-10-06T04:16:56.666338+0000","last_active":"2023-10-06T04:16:56.669397+0000","last_peered":"2023-10-06T04:16:56.669397+0000","last_clean":"2023-10-06T04:16:56.669397+0000","last_became_active":"2023-10-06T04:16:56.666070+0000","last_became_peered":"2023-10-06T04:16:56.666070+0000","last_unstale":"2023-10-06T04:16:56.669397+0000","last_undegraded":"2023-10-06T04:16:56.669397+0000","last_fullsized":"2023-10-06T04:16:56.669397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:03.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692755+0000","last_change":"2023-10-06T04:16:55.654834+0000","last_active":"2023-10-06T04:16:56.692755+0000","last_peered":"2023-10-06T04:16:56.692755+0000","last_clean":"2023-10-06T04:16:56.692755+0000","last_became_active":"2023-10-06T04:16:55.654571+0000","last_became_peered":"2023-10-06T04:16:55.654571+0000","last_unstale":"2023-10-06T04:16:56.692755+0000","last_undegraded":"2023-10-06T04:16:56.692755+0000","last_fullsized":"2023-10-06T04:16:56.692755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:19.386895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670632+0000","last_change":"2023-10-06T04:16:56.665346+0000","last_active":"2023-10-06T04:16:56.670632+0000","last_peered":"2023-10-06T04:16:56.670632+0000","last_clean":"2023-10-06T04:16:56.670632+0000","last_became_active":"2023-10-06T04:16:56.665106+0000","last_became_peered":"2023-10-06T04:16:56.665106+0000","last_unstale":"2023-10-06T04:16:56.670632+0000","last_undegraded":"2023-10-06T04:16:56.670632+0000","last_fullsized":"2023-10-06T04:16:56.670632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:08.284193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693453+0000","last_change":"2023-10-06T04:16:55.646833+0000","last_active":"2023-10-06T04:16:56.693453+0000","last_peered":"2023-10-06T04:16:56.693453+0000","last_clean":"2023-10-06T04:16:56.693453+0000","last_became_active":"2023-10-06T04:16:55.646559+0000","last_became_peered":"2023-10-06T04:16:55.646559+0000","last_unstale":"2023-10-06T04:16:56.693453+0000","last_undegraded":"2023-10-06T04:16:56.693453+0000","last_fullsized":"2023-10-06T04:16:56.693453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:35.993274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674138+0000","last_change":"2023-10-06T04:16:56.672813+0000","last_active":"2023-10-06T04:16:56.674138+0000","last_peered":"2023-10-06T04:16:56.674138+0000","last_clean":"2023-10-06T04:16:56.674138+0000","last_became_active":"2023-10-06T04:16:56.672433+0000","last_became_peered":"2023-10-06T04:16:56.672433+0000","last_unstale":"2023-10-06T04:16:56.674138+0000","last_undegraded":"2023-10-06T04:16:56.674138+0000","last_fullsized":"2023-10-06T04:16:56.674138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:32:55.662487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653810+0000","last_change":"2023-10-06T04:16:55.648678+0000","last_active":"2023-10-06T04:16:56.653810+0000","last_peered":"2023-10-06T04:16:56.653810+0000","last_clean":"2023-10-06T04:16:56.653810+0000","last_became_active":"2023-10-06T04:16:55.648371+0000","last_became_peered":"2023-10-06T04:16:55.648371+0000","last_unstale":"2023-10-06T04:16:56.653810+0000","last_undegraded":"2023-10-06T04:16:56.653810+0000","last_fullsized":"2023-10-06T04:16:56.653810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676608+0000","last_change":"2023-10-06T04:16:56.675176+0000","last_active":"2023-10-06T04:16:56.676608+0000","last_peered":"2023-10-06T04:16:56.676608+0000","last_clean":"2023-10-06T04:16:56.676608+0000","last_became_active":"2023-10-06T04:16:56.674871+0000","last_became_peered":"2023-10-06T04:16:56.674871+0000","last_unstale":"2023-10-06T04:16:56.676608+0000","last_undegraded":"2023-10-06T04:16:56.676608+0000","last_fullsized":"2023-10-06T04:16:56.676608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691464+0000","last_change":"2023-10-06T04:16:55.652840+0000","last_active":"2023-10-06T04:16:56.691464+0000","last_peered":"2023-10-06T04:16:56.691464+0000","last_clean":"2023-10-06T04:16:56.691464+0000","last_became_active":"2023-10-06T04:16:55.652462+0000","last_became_peered":"2023-10-06T04:16:55.652462+0000","last_unstale":"2023-10-06T04:16:56.691464+0000","last_undegraded":"2023-10-06T04:16:56.691464+0000","last_fullsized":"2023-10-06T04:16:56.691464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666039+0000","last_change":"2023-10-06T04:16:56.664308+0000","last_active":"2023-10-06T04:16:56.666039+0000","last_peered":"2023-10-06T04:16:56.666039+0000","last_clean":"2023-10-06T04:16:56.666039+0000","last_became_active":"2023-10-06T04:16:56.664011+0000","last_became_peered":"2023-10-06T04:16:56.664011+0000","last_unstale":"2023-10-06T04:16:56.666039+0000","last_undegraded":"2023-10-06T04:16:56.666039+0000","last_fullsized":"2023-10-06T04:16:56.666039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:49.601120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663190+0000","last_change":"2023-10-06T04:16:55.654980+0000","last_active":"2023-10-06T04:16:56.663190+0000","last_peered":"2023-10-06T04:16:56.663190+0000","last_clean":"2023-10-06T04:16:56.663190+0000","last_became_active":"2023-10-06T04:16:55.654710+0000","last_became_peered":"2023-10-06T04:16:55.654710+0000","last_unstale":"2023-10-06T04:16:56.663190+0000","last_undegraded":"2023-10-06T04:16:56.663190+0000","last_fullsized":"2023-10-06T04:16:56.663190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666606+0000","last_change":"2023-10-06T04:16:56.664458+0000","last_active":"2023-10-06T04:16:56.666606+0000","last_peered":"2023-10-06T04:16:56.666606+0000","last_clean":"2023-10-06T04:16:56.666606+0000","last_became_active":"2023-10-06T04:16:56.664213+0000","last_became_peered":"2023-10-06T04:16:56.664213+0000","last_unstale":"2023-10-06T04:16:56.666606+0000","last_undegraded":"2023-10-06T04:16:56.666606+0000","last_fullsized":"2023-10-06T04:16:56.666606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655273+0000","last_change":"2023-10-06T04:16:55.647489+0000","last_active":"2023-10-06T04:16:56.655273+0000","last_peered":"2023-10-06T04:16:56.655273+0000","last_clean":"2023-10-06T04:16:56.655273+0000","last_became_active":"2023-10-06T04:16:55.647201+0000","last_became_peered":"2023-10-06T04:16:55.647201+0000","last_unstale":"2023-10-06T04:16:56.655273+0000","last_undegraded":"2023-10-06T04:16:56.655273+0000","last_fullsized":"2023-10-06T04:16:56.655273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:50.104915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672175+0000","last_change":"2023-10-06T04:16:56.668413+0000","last_active":"2023-10-06T04:16:56.672175+0000","last_peered":"2023-10-06T04:16:56.672175+0000","last_clean":"2023-10-06T04:16:56.672175+0000","last_became_active":"2023-10-06T04:16:56.668093+0000","last_became_peered":"2023-10-06T04:16:56.668093+0000","last_unstale":"2023-10-06T04:16:56.672175+0000","last_undegraded":"2023-10-06T04:16:56.672175+0000","last_fullsized":"2023-10-06T04:16:56.672175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:25.164410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657650+0000","last_change":"2023-10-06T04:16:55.648749+0000","last_active":"2023-10-06T04:16:56.657650+0000","last_peered":"2023-10-06T04:16:56.657650+0000","last_clean":"2023-10-06T04:16:56.657650+0000","last_became_active":"2023-10-06T04:16:55.648465+0000","last_became_peered":"2023-10-06T04:16:55.648465+0000","last_unstale":"2023-10-06T04:16:56.657650+0000","last_undegraded":"2023-10-06T04:16:56.657650+0000","last_fullsized":"2023-10-06T04:16:56.657650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:36.234415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673361+0000","last_change":"2023-10-06T04:16:56.671285+0000","last_active":"2023-10-06T04:16:56.673361+0000","last_peered":"2023-10-06T04:16:56.673361+0000","last_clean":"2023-10-06T04:16:56.673361+0000","last_became_active":"2023-10-06T04:16:56.671009+0000","last_became_peered":"2023-10-06T04:16:56.671009+0000","last_unstale":"2023-10-06T04:16:56.673361+0000","last_undegraded":"2023-10-06T04:16:56.673361+0000","last_fullsized":"2023-10-06T04:16:56.673361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:14.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658750+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:16:56.658750+0000","last_peered":"2023-10-06T04:16:56.658750+0000","last_clean":"2023-10-06T04:16:56.658750+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:16:56.658750+0000","last_undegraded":"2023-10-06T04:16:56.658750+0000","last_fullsized":"2023-10-06T04:16:56.658750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.657337+0000","last_change":"2023-10-06T04:16:55.648680+0000","last_active":"2023-10-06T04:16:56.657337+0000","last_peered":"2023-10-06T04:16:56.657337+0000","last_clean":"2023-10-06T04:16:56.657337+0000","last_became_active":"2023-10-06T04:16:55.648417+0000","last_became_peered":"2023-10-06T04:16:55.648417+0000","last_unstale":"2023-10-06T04:16:56.657337+0000","last_undegraded":"2023-10-06T04:16:56.657337+0000","last_fullsized":"2023-10-06T04:16:56.657337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:13.699754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671795+0000","last_change":"2023-10-06T04:16:56.660763+0000","last_active":"2023-10-06T04:16:56.671795+0000","last_peered":"2023-10-06T04:16:56.671795+0000","last_clean":"2023-10-06T04:16:56.671795+0000","last_became_active":"2023-10-06T04:16:56.660470+0000","last_became_peered":"2023-10-06T04:16:56.660470+0000","last_unstale":"2023-10-06T04:16:56.671795+0000","last_undegraded":"2023-10-06T04:16:56.671795+0000","last_fullsized":"2023-10-06T04:16:56.671795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:46.674115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.654303+0000","last_change":"2023-10-06T04:16:55.653618+0000","last_active":"2023-10-06T04:16:56.654303+0000","last_peered":"2023-10-06T04:16:56.654303+0000","last_clean":"2023-10-06T04:16:56.654303+0000","last_became_active":"2023-10-06T04:16:55.653410+0000","last_became_peered":"2023-10-06T04:16:55.653410+0000","last_unstale":"2023-10-06T04:16:56.654303+0000","last_undegraded":"2023-10-06T04:16:56.654303+0000","last_fullsized":"2023-10-06T04:16:56.654303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:54.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.669999+0000","last_change":"2023-10-06T04:16:56.665106+0000","last_active":"2023-10-06T04:16:56.669999+0000","last_peered":"2023-10-06T04:16:56.669999+0000","last_clean":"2023-10-06T04:16:56.669999+0000","last_became_active":"2023-10-06T04:16:56.664811+0000","last_became_peered":"2023-10-06T04:16:56.664811+0000","last_unstale":"2023-10-06T04:16:56.669999+0000","last_undegraded":"2023-10-06T04:16:56.669999+0000","last_fullsized":"2023-10-06T04:16:56.669999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.652014+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:16:56.652014+0000","last_peered":"2023-10-06T04:16:56.652014+0000","last_clean":"2023-10-06T04:16:56.652014+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:16:56.652014+0000","last_undegraded":"2023-10-06T04:16:56.652014+0000","last_fullsized":"2023-10-06T04:16:56.652014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658314+0000","last_change":"2023-10-06T04:16:55.646128+0000","last_active":"2023-10-06T04:16:56.658314+0000","last_peered":"2023-10-06T04:16:56.658314+0000","last_clean":"2023-10-06T04:16:56.658314+0000","last_became_active":"2023-10-06T04:16:55.645702+0000","last_became_peered":"2023-10-06T04:16:55.645702+0000","last_unstale":"2023-10-06T04:16:56.658314+0000","last_undegraded":"2023-10-06T04:16:56.658314+0000","last_fullsized":"2023-10-06T04:16:56.658314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.668964+0000","last_change":"2023-10-06T04:16:56.661671+0000","last_active":"2023-10-06T04:16:56.668964+0000","last_peered":"2023-10-06T04:16:56.668964+0000","last_clean":"2023-10-06T04:16:56.668964+0000","last_became_active":"2023-10-06T04:16:56.660697+0000","last_became_peered":"2023-10-06T04:16:56.660697+0000","last_unstale":"2023-10-06T04:16:56.668964+0000","last_undegraded":"2023-10-06T04:16:56.668964+0000","last_fullsized":"2023-10-06T04:16:56.668964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.653351+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:16:56.653351+0000","last_peered":"2023-10-06T04:16:56.653351+0000","last_clean":"2023-10-06T04:16:56.653351+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:16:56.653351+0000","last_undegraded":"2023-10-06T04:16:56.653351+0000","last_fullsized":"2023-10-06T04:16:56.653351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660306+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:16:56.660306+0000","last_peered":"2023-10-06T04:16:56.660306+0000","last_clean":"2023-10-06T04:16:56.660306+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:16:56.660306+0000","last_undegraded":"2023-10-06T04:16:56.660306+0000","last_fullsized":"2023-10-06T04:16:56.660306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.655543+0000","last_change":"2023-10-06T04:16:55.645182+0000","last_active":"2023-10-06T04:16:56.655543+0000","last_peered":"2023-10-06T04:16:56.655543+0000","last_clean":"2023-10-06T04:16:56.655543+0000","last_became_active":"2023-10-06T04:16:55.644889+0000","last_became_peered":"2023-10-06T04:16:55.644889+0000","last_unstale":"2023-10-06T04:16:56.655543+0000","last_undegraded":"2023-10-06T04:16:56.655543+0000","last_fullsized":"2023-10-06T04:16:56.655543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:59.243237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672541+0000","last_change":"2023-10-06T04:16:56.671575+0000","last_active":"2023-10-06T04:16:56.672541+0000","last_peered":"2023-10-06T04:16:56.672541+0000","last_clean":"2023-10-06T04:16:56.672541+0000","last_became_active":"2023-10-06T04:16:56.671276+0000","last_became_peered":"2023-10-06T04:16:56.671276+0000","last_unstale":"2023-10-06T04:16:56.672541+0000","last_undegraded":"2023-10-06T04:16:56.672541+0000","last_fullsized":"2023-10-06T04:16:56.672541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:14.709239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.660411+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:16:56.660411+0000","last_peered":"2023-10-06T04:16:56.660411+0000","last_clean":"2023-10-06T04:16:56.660411+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:16:56.660411+0000","last_undegraded":"2023-10-06T04:16:56.660411+0000","last_fullsized":"2023-10-06T04:16:56.660411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.664829+0000","last_change":"2023-10-06T04:16:55.646360+0000","last_active":"2023-10-06T04:16:56.664829+0000","last_peered":"2023-10-06T04:16:56.664829+0000","last_clean":"2023-10-06T04:16:56.664829+0000","last_became_active":"2023-10-06T04:16:55.645977+0000","last_became_peered":"2023-10-06T04:16:55.645977+0000","last_unstale":"2023-10-06T04:16:56.664829+0000","last_undegraded":"2023-10-06T04:16:56.664829+0000","last_fullsized":"2023-10-06T04:16:56.664829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.678965+0000","last_change":"2023-10-06T04:16:56.677307+0000","last_active":"2023-10-06T04:16:56.678965+0000","last_peered":"2023-10-06T04:16:56.678965+0000","last_clean":"2023-10-06T04:16:56.678965+0000","last_became_active":"2023-10-06T04:16:56.676460+0000","last_became_peered":"2023-10-06T04:16:56.676460+0000","last_unstale":"2023-10-06T04:16:56.678965+0000","last_undegraded":"2023-10-06T04:16:56.678965+0000","last_fullsized":"2023-10-06T04:16:56.678965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.663629+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:16:56.663629+0000","last_peered":"2023-10-06T04:16:56.663629+0000","last_clean":"2023-10-06T04:16:56.663629+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:16:56.663629+0000","last_undegraded":"2023-10-06T04:16:56.663629+0000","last_fullsized":"2023-10-06T04:16:56.663629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658864+0000","last_change":"2023-10-06T04:16:55.649571+0000","last_active":"2023-10-06T04:16:56.658864+0000","last_peered":"2023-10-06T04:16:56.658864+0000","last_clean":"2023-10-06T04:16:56.658864+0000","last_became_active":"2023-10-06T04:16:55.646950+0000","last_became_peered":"2023-10-06T04:16:55.646950+0000","last_unstale":"2023-10-06T04:16:56.658864+0000","last_undegraded":"2023-10-06T04:16:56.658864+0000","last_fullsized":"2023-10-06T04:16:56.658864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676108+0000","last_change":"2023-10-06T04:16:56.669292+0000","last_active":"2023-10-06T04:16:56.676108+0000","last_peered":"2023-10-06T04:16:56.676108+0000","last_clean":"2023-10-06T04:16:56.676108+0000","last_became_active":"2023-10-06T04:16:56.668986+0000","last_became_peered":"2023-10-06T04:16:56.668986+0000","last_unstale":"2023-10-06T04:16:56.676108+0000","last_undegraded":"2023-10-06T04:16:56.676108+0000","last_fullsized":"2023-10-06T04:16:56.676108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:57.409648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.692290+0000","last_change":"2023-10-06T04:16:55.651045+0000","last_active":"2023-10-06T04:16:56.692290+0000","last_peered":"2023-10-06T04:16:56.692290+0000","last_clean":"2023-10-06T04:16:56.692290+0000","last_became_active":"2023-10-06T04:16:55.650778+0000","last_became_peered":"2023-10-06T04:16:55.650778+0000","last_unstale":"2023-10-06T04:16:56.692290+0000","last_undegraded":"2023-10-06T04:16:56.692290+0000","last_fullsized":"2023-10-06T04:16:56.692290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:44.913618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.658866+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:16:56.658866+0000","last_peered":"2023-10-06T04:16:56.658866+0000","last_clean":"2023-10-06T04:16:56.658866+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:16:56.658866+0000","last_undegraded":"2023-10-06T04:16:56.658866+0000","last_fullsized":"2023-10-06T04:16:56.658866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676714+0000","last_change":"2023-10-06T04:16:56.673874+0000","last_active":"2023-10-06T04:16:56.676714+0000","last_peered":"2023-10-06T04:16:56.676714+0000","last_clean":"2023-10-06T04:16:56.676714+0000","last_became_active":"2023-10-06T04:16:56.673236+0000","last_became_peered":"2023-10-06T04:16:56.673236+0000","last_unstale":"2023-10-06T04:16:56.676714+0000","last_undegraded":"2023-10-06T04:16:56.676714+0000","last_fullsized":"2023-10-06T04:16:56.676714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:04.475243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.662103+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:16:56.662103+0000","last_peered":"2023-10-06T04:16:56.662103+0000","last_clean":"2023-10-06T04:16:56.662103+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:16:56.662103+0000","last_undegraded":"2023-10-06T04:16:56.662103+0000","last_fullsized":"2023-10-06T04:16:56.662103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T04:16:57.674758+0000","last_change":"2023-10-06T04:16:55.651462+0000","last_active":"2023-10-06T04:16:57.674758+0000","last_peered":"2023-10-06T04:16:57.674758+0000","last_clean":"2023-10-06T04:16:57.674758+0000","last_became_active":"2023-10-06T04:16:55.651201+0000","last_became_peered":"2023-10-06T04:16:55.651201+0000","last_unstale":"2023-10-06T04:16:57.674758+0000","last_undegraded":"2023-10-06T04:16:57.674758+0000","last_fullsized":"2023-10-06T04:16:57.674758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665712+0000","last_change":"2023-10-06T04:16:56.659978+0000","last_active":"2023-10-06T04:16:56.665712+0000","last_peered":"2023-10-06T04:16:56.665712+0000","last_clean":"2023-10-06T04:16:56.665712+0000","last_became_active":"2023-10-06T04:16:56.659701+0000","last_became_peered":"2023-10-06T04:16:56.659701+0000","last_unstale":"2023-10-06T04:16:56.665712+0000","last_undegraded":"2023-10-06T04:16:56.665712+0000","last_fullsized":"2023-10-06T04:16:56.665712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:10.150780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691318+0000","last_change":"2023-10-06T04:16:55.654822+0000","last_active":"2023-10-06T04:16:56.691318+0000","last_peered":"2023-10-06T04:16:56.691318+0000","last_clean":"2023-10-06T04:16:56.691318+0000","last_became_active":"2023-10-06T04:16:55.654536+0000","last_became_peered":"2023-10-06T04:16:55.654536+0000","last_unstale":"2023-10-06T04:16:56.691318+0000","last_undegraded":"2023-10-06T04:16:56.691318+0000","last_fullsized":"2023-10-06T04:16:56.691318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:16.439381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.673783+0000","last_change":"2023-10-06T04:16:56.666213+0000","last_active":"2023-10-06T04:16:56.673783+0000","last_peered":"2023-10-06T04:16:56.673783+0000","last_clean":"2023-10-06T04:16:56.673783+0000","last_became_active":"2023-10-06T04:16:56.665929+0000","last_became_peered":"2023-10-06T04:16:56.665929+0000","last_unstale":"2023-10-06T04:16:56.673783+0000","last_undegraded":"2023-10-06T04:16:56.673783+0000","last_fullsized":"2023-10-06T04:16:56.673783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691805+0000","last_change":"2023-10-06T04:16:55.648120+0000","last_active":"2023-10-06T04:16:56.691805+0000","last_peered":"2023-10-06T04:16:56.691805+0000","last_clean":"2023-10-06T04:16:56.691805+0000","last_became_active":"2023-10-06T04:16:55.647829+0000","last_became_peered":"2023-10-06T04:16:55.647829+0000","last_unstale":"2023-10-06T04:16:56.691805+0000","last_undegraded":"2023-10-06T04:16:56.691805+0000","last_fullsized":"2023-10-06T04:16:56.691805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.665999+0000","last_change":"2023-10-06T04:16:56.663079+0000","last_active":"2023-10-06T04:16:56.665999+0000","last_peered":"2023-10-06T04:16:56.665999+0000","last_clean":"2023-10-06T04:16:56.665999+0000","last_became_active":"2023-10-06T04:16:56.662838+0000","last_became_peered":"2023-10-06T04:16:56.662838+0000","last_unstale":"2023-10-06T04:16:56.665999+0000","last_undegraded":"2023-10-06T04:16:56.665999+0000","last_fullsized":"2023-10-06T04:16:56.665999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:22.046890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.691400+0000","last_change":"2023-10-06T04:16:55.649819+0000","last_active":"2023-10-06T04:16:56.691400+0000","last_peered":"2023-10-06T04:16:56.691400+0000","last_clean":"2023-10-06T04:16:56.691400+0000","last_became_active":"2023-10-06T04:16:55.649539+0000","last_became_peered":"2023-10-06T04:16:55.649539+0000","last_unstale":"2023-10-06T04:16:56.691400+0000","last_undegraded":"2023-10-06T04:16:56.691400+0000","last_fullsized":"2023-10-06T04:16:56.691400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:08.170962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.666210+0000","last_change":"2023-10-06T04:16:56.664312+0000","last_active":"2023-10-06T04:16:56.666210+0000","last_peered":"2023-10-06T04:16:56.666210+0000","last_clean":"2023-10-06T04:16:56.666210+0000","last_became_active":"2023-10-06T04:16:56.664028+0000","last_became_peered":"2023-10-06T04:16:56.664028+0000","last_unstale":"2023-10-06T04:16:56.666210+0000","last_undegraded":"2023-10-06T04:16:56.666210+0000","last_fullsized":"2023-10-06T04:16:56.666210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:57.169230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.688921+0000","last_change":"2023-10-06T04:16:55.648999+0000","last_active":"2023-10-06T04:16:56.688921+0000","last_peered":"2023-10-06T04:16:56.688921+0000","last_clean":"2023-10-06T04:16:56.688921+0000","last_became_active":"2023-10-06T04:16:55.648714+0000","last_became_peered":"2023-10-06T04:16:55.648714+0000","last_unstale":"2023-10-06T04:16:56.688921+0000","last_undegraded":"2023-10-06T04:16:56.688921+0000","last_fullsized":"2023-10-06T04:16:56.688921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:03.958654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.670590+0000","last_change":"2023-10-06T04:16:56.666518+0000","last_active":"2023-10-06T04:16:56.670590+0000","last_peered":"2023-10-06T04:16:56.670590+0000","last_clean":"2023-10-06T04:16:56.670590+0000","last_became_active":"2023-10-06T04:16:56.666210+0000","last_became_peered":"2023-10-06T04:16:56.666210+0000","last_unstale":"2023-10-06T04:16:56.670590+0000","last_undegraded":"2023-10-06T04:16:56.670590+0000","last_fullsized":"2023-10-06T04:16:56.670590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:20:47.974378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.693693+0000","last_change":"2023-10-06T04:16:55.654612+0000","last_active":"2023-10-06T04:16:56.693693+0000","last_peered":"2023-10-06T04:16:56.693693+0000","last_clean":"2023-10-06T04:16:56.693693+0000","last_became_active":"2023-10-06T04:16:55.654276+0000","last_became_peered":"2023-10-06T04:16:55.654276+0000","last_unstale":"2023-10-06T04:16:56.693693+0000","last_undegraded":"2023-10-06T04:16:56.693693+0000","last_fullsized":"2023-10-06T04:16:56.693693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:54.620164+0000","last_clean_scrub_stamp":"2023-10-06T04:16:54.620164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:51.666785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671474+0000","last_change":"2023-10-06T04:16:56.666522+0000","last_active":"2023-10-06T04:16:56.671474+0000","last_peered":"2023-10-06T04:16:56.671474+0000","last_clean":"2023-10-06T04:16:56.671474+0000","last_became_active":"2023-10-06T04:16:56.666259+0000","last_became_peered":"2023-10-06T04:16:56.666259+0000","last_unstale":"2023-10-06T04:16:56.671474+0000","last_undegraded":"2023-10-06T04:16:56.671474+0000","last_fullsized":"2023-10-06T04:16:56.671474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.674341+0000","last_change":"2023-10-06T04:16:56.672889+0000","last_active":"2023-10-06T04:16:56.674341+0000","last_peered":"2023-10-06T04:16:56.674341+0000","last_clean":"2023-10-06T04:16:56.674341+0000","last_became_active":"2023-10-06T04:16:56.672585+0000","last_became_peered":"2023-10-06T04:16:56.672585+0000","last_unstale":"2023-10-06T04:16:56.674341+0000","last_undegraded":"2023-10-06T04:16:56.674341+0000","last_fullsized":"2023-10-06T04:16:56.674341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.676270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676761+0000","last_change":"2023-10-06T04:16:56.671951+0000","last_active":"2023-10-06T04:16:56.676761+0000","last_peered":"2023-10-06T04:16:56.676761+0000","last_clean":"2023-10-06T04:16:56.676761+0000","last_became_active":"2023-10-06T04:16:56.671467+0000","last_became_peered":"2023-10-06T04:16:56.671467+0000","last_unstale":"2023-10-06T04:16:56.676761+0000","last_undegraded":"2023-10-06T04:16:56.676761+0000","last_fullsized":"2023-10-06T04:16:56.676761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.672197+0000","last_change":"2023-10-06T04:16:56.668427+0000","last_active":"2023-10-06T04:16:56.672197+0000","last_peered":"2023-10-06T04:16:56.672197+0000","last_clean":"2023-10-06T04:16:56.672197+0000","last_became_active":"2023-10-06T04:16:56.668119+0000","last_became_peered":"2023-10-06T04:16:56.668119+0000","last_unstale":"2023-10-06T04:16:56.672197+0000","last_undegraded":"2023-10-06T04:16:56.672197+0000","last_fullsized":"2023-10-06T04:16:56.672197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:54.994015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.676893+0000","last_change":"2023-10-06T04:16:56.670079+0000","last_active":"2023-10-06T04:16:56.676893+0000","last_peered":"2023-10-06T04:16:56.676893+0000","last_clean":"2023-10-06T04:16:56.676893+0000","last_became_active":"2023-10-06T04:16:56.669692+0000","last_became_peered":"2023-10-06T04:16:56.669692+0000","last_unstale":"2023-10-06T04:16:56.676893+0000","last_undegraded":"2023-10-06T04:16:56.676893+0000","last_fullsized":"2023-10-06T04:16:56.676893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:43.626813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T04:16:56.671532+0000","last_change":"2023-10-06T04:16:56.669243+0000","last_active":"2023-10-06T04:16:56.671532+0000","last_peered":"2023-10-06T04:16:56.671532+0000","last_clean":"2023-10-06T04:16:56.671532+0000","last_became_active":"2023-10-06T04:16:56.668889+0000","last_became_peered":"2023-10-06T04:16:56.668889+0000","last_unstale":"2023-10-06T04:16:56.671532+0000","last_undegraded":"2023-10-06T04:16:56.671532+0000","last_fullsized":"2023-10-06T04:16:56.671532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:55.629650+0000","last_clean_scrub_stamp":"2023-10-06T04:16:55.629650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:07.886905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":681439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":680241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":245760,"data_stored":89409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":90911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":89943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:08.681 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:17:08.681 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:17:08.681 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:17:08.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:17:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.831+0000 7f4d9ce70700 1 Processor -- start 2023-10-06T04:17:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.831+0000 7f4d9ce70700 1 -- start start 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d9ce70700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d980aec50 0x7f4d98068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d9ce70700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4d98068bb0 0x7f4d98156de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d9ce70700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d98069d20 con 0x7f4d980abe80 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d9ce70700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9806ab80 con 0x7f4d980aec50 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d9ce70700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d98068fd0 con 0x7f4d98068bb0 2023-10-06T04:17:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d977fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4d980abe80 0x7f4d980ae540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58494/0 (socket says 172.21.15.37:58494) 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d977fe700 1 -- 172.21.15.37:0/4055182350 learned_addr learned my addr 172.21.15.37:0/4055182350 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/4055182350 >> v2:172.21.15.37:3300/0 conn(0x7f4d980aec50 0x7f4d98068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d967fc700 1 -- 172.21.15.37:0/4055182350 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592182862 0 0) 0x7f4d98069d20 con 0x7f4d980abe80 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d97fff700 1 --2- 172.21.15.37:0/4055182350 >> v2:172.21.15.83:3300/0 conn(0x7f4d98068bb0 0x7f4d98156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d967fc700 1 -- 172.21.15.37:0/4055182350 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d80003570 con 0x7f4d980abe80 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d96ffd700 1 -- 172.21.15.37:0/4055182350 >> v2:172.21.15.83:3300/0 conn(0x7f4d98068bb0 msgr2=0x7f4d98156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/4055182350 >> v2:172.21.15.83:3300/0 conn(0x7f4d98068bb0 0x7f4d98156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d96ffd700 1 -- 172.21.15.37:0/4055182350 >> v1:172.21.15.37:6789/0 conn(0x7f4d980abe80 legacy=0x7f4d980ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.832+0000 7f4d96ffd700 1 -- 172.21.15.37:0/4055182350 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98069f70 con 0x7f4d980aec50 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/4055182350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980aec50 0x7f4d98068670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d980c38a0 tx=0x7f4d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b767b5d5199ac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d967fc700 1 -- 172.21.15.37:0/4055182350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c011630 con 0x7f4d980aec50 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d967fc700 1 -- 172.21.15.37:0/4055182350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c011790 con 0x7f4d980aec50 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d967fc700 1 -- 172.21.15.37:0/4055182350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c011b30 con 0x7f4d980aec50 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 -- 172.21.15.37:0/4055182350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980aec50 msgr2=0x7f4d98068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/4055182350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980aec50 0x7f4d98068670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d980c38a0 tx=0x7f4d8c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 -- 172.21.15.37:0/4055182350 shutdown_connections 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/4055182350 >> v2:172.21.15.83:3300/0 conn(0x7f4d98068bb0 0x7f4d98156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/4055182350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980aec50 0x7f4d98068670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 -- 172.21.15.37:0/4055182350 >> 172.21.15.37:0/4055182350 conn(0x7f4d980c9e60 msgr2=0x7f4d9806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 -- 172.21.15.37:0/4055182350 shutdown_connections 2023-10-06T04:17:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.833+0000 7f4d9ce70700 1 -- 172.21.15.37:0/4055182350 wait complete. 2023-10-06T04:17:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 Processor -- start 2023-10-06T04:17:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 -- start start 2023-10-06T04:17:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 0x7f4d980c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d980aec50 0x7f4d981654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c6960 con 0x7f4d980abe80 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c41c0 con 0x7f4d980aec50 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d9ce70700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c4420 con 0x7f4d98068bb0 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d96ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d96ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40008/0 (socket says 172.21.15.37:40008) 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d96ffd700 1 -- 172.21.15.37:0/3609961577 learned_addr learned my addr 172.21.15.37:0/3609961577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d97fff700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d980aec50 0x7f4d981654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.835+0000 7f4d977fe700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 0x7f4d980c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 -- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 msgr2=0x7f4d980c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 0x7f4d980c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 -- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d980aec50 msgr2=0x7f4d981654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d980aec50 0x7f4d981654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 -- 172.21.15.37:0/3609961577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c009420 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d977fe700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 0x7f4d980c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d96ffd700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806d670 tx=0x7f4d8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c011b10 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0253f0 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d980c4700 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c025790 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.836+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980c4cc0 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.837+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9804c3c0 con 0x7f4d980abe80 2023-10-06T04:17:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.837+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d8c025b80 con 0x7f4d980abe80 2023-10-06T04:17:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.838+0000 7f4d7f7fe700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.838+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d8c085e70 con 0x7f4d980abe80 2023-10-06T04:17:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.838+0000 7f4d977fe700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.839+0000 7f4d977fe700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 0x7f4d840693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d880058d0 tx=0x7f4d88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:08.842+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d8c052f80 con 0x7f4d980abe80 2023-10-06T04:17:09.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.078+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d980adec0 con 0x7f4d980abe80 2023-10-06T04:17:09.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.078+0000 7f4d7f7fe700 1 -- 172.21.15.37:0/3609961577 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4d8c0565a0 con 0x7f4d980abe80 2023-10-06T04:17:09.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:09.081 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:17:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 msgr2=0x7f4d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 0x7f4d840693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d880058d0 tx=0x7f4d88009040 comp rx=0 tx=0).stop 2023-10-06T04:17:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 msgr2=0x7f4d980c3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806d670 tx=0x7f4d8c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 shutdown_connections 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d980aec50 0x7f4d981654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4d98068bb0 0x7f4d980c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.080+0000 7f4d9ce70700 1 --2- 172.21.15.37:0/3609961577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d980abe80 0x7f4d980c3c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.081+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 >> 172.21.15.37:0/3609961577 conn(0x7f4d980c9e60 msgr2=0x7f4d980cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.081+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 shutdown_connections 2023-10-06T04:17:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.081+0000 7f4d9ce70700 1 -- 172.21.15.37:0/3609961577 wait complete. 2023-10-06T04:17:09.095 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:17:09.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.213+0000 7f9dda14d700 1 Processor -- start 2023-10-06T04:17:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.213+0000 7f9dda14d700 1 -- start start 2023-10-06T04:17:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dda14d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd40cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dda14d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9dd40ce780 0x7f9dd415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dda14d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd40cebe0 con 0x7f9dd40b2810 2023-10-06T04:17:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dda14d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4159b40 con 0x7f9dd40ce780 2023-10-06T04:17:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dda14d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd40cfa20 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd994c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9dd40ce780 0x7f9dd415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd914b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9dd40b2810 0x7f9dd40ccbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:53688/0 (socket says 172.21.15.37:53688) 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd914b700 1 -- 172.21.15.37:0/3755465623 learned_addr learned my addr 172.21.15.37:0/3755465623 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd894a700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd40cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd994c700 1 -- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 msgr2=0x7f9dd40cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd994c700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd40cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd994c700 1 -- 172.21.15.37:0/3755465623 >> v1:172.21.15.83:6789/0 conn(0x7f9dd40b2810 legacy=0x7f9dd40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.214+0000 7f9dd994c700 1 -- 172.21.15.37:0/3755465623 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd415e140 con 0x7f9dd40ce780 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dd994c700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd415dc00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009e60 tx=0x7f9dc4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db8af1268f93da50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dd3fff700 1 -- 172.21.15.37:0/3755465623 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400e070 con 0x7f9dd40ce780 2023-10-06T04:17:09.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dd3fff700 1 -- 172.21.15.37:0/3755465623 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc400bb60 con 0x7f9dd40ce780 2023-10-06T04:17:09.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dd3fff700 1 -- 172.21.15.37:0/3755465623 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4012430 con 0x7f9dd40ce780 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 -- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 msgr2=0x7f9dd415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd415dc00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009e60 tx=0x7f9dc4009780 comp rx=0 tx=0).stop 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 -- 172.21.15.37:0/3755465623 shutdown_connections 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd415dc00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 --2- 172.21.15.37:0/3755465623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd40cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 -- 172.21.15.37:0/3755465623 >> 172.21.15.37:0/3755465623 conn(0x7f9dd406ed90 msgr2=0x7f9dd406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 -- 172.21.15.37:0/3755465623 shutdown_connections 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.215+0000 7f9dda14d700 1 -- 172.21.15.37:0/3755465623 wait complete. 2023-10-06T04:17:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.216+0000 7f9dda14d700 1 Processor -- start 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 -- start start 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4159c80 con 0x7f9dd40b2810 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd415a800 con 0x7f9dd40ce780 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dda14d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd40b54f0 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.217+0000 7f9dd914b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd914b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40020/0 (socket says 172.21.15.37:40020) 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd914b700 1 -- 172.21.15.37:0/2178501066 learned_addr learned my addr 172.21.15.37:0/2178501066 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd994c700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 -- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 msgr2=0x7f9dd40b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd40b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 -- 172.21.15.37:0/2178501066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 msgr2=0x7f9dd41567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 -- 172.21.15.37:0/2178501066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc4009a20 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd914b700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd894a700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd415ac90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800ea50 tx=0x7f9dc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800ee90 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc800c7f0 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd4159ed0 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800cb90 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.218+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd415a490 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.219+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd404c3c0 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.220+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dc8013470 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.220+0000 7f9dd17fa700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.220+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9dc8084850 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.220+0000 7f9dd914b700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.221+0000 7f9dd914b700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 0x7f9dc00693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40cc440 tx=0x7f9dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.225+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dc8051960 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.418+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd40cee10 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.419+0000 7f9dd17fa700 1 -- 172.21.15.37:0/2178501066 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f9dc8021090 con 0x7f9dd40cd2c0 2023-10-06T04:17:09.422 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:09.422 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:09.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.421+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 msgr2=0x7f9dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.421+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 0x7f9dc00693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40cc440 tx=0x7f9dcc009040 comp rx=0 tx=0).stop 2023-10-06T04:17:09.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.421+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 msgr2=0x7f9dd415ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.421+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd415ac90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800ea50 tx=0x7f9dc80091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 shutdown_connections 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9dd40ce780 0x7f9dd40b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd40b2810 0x7f9dd41567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 --2- 172.21.15.37:0/2178501066 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9dd40cd2c0 0x7f9dd415ac90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 >> 172.21.15.37:0/2178501066 conn(0x7f9dd406ed90 msgr2=0x7f9dd415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 shutdown_connections 2023-10-06T04:17:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.422+0000 7f9dda14d700 1 -- 172.21.15.37:0/2178501066 wait complete. 2023-10-06T04:17:09.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:09.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.556+0000 7fa2c6896700 1 Processor -- start 2023-10-06T04:17:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.556+0000 7fa2c6896700 1 -- start start 2023-10-06T04:17:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c6896700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2c00ce260 0x7fa2c00cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c6896700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa2c00ceff0 0x7fa2c00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c6896700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00cdb20 con 0x7fa2c0159dc0 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c6896700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00b3090 con 0x7fa2c00ce260 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c6896700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00cf9b0 con 0x7fa2c00ceff0 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2bf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2c00ce260 0x7fa2c00cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2bf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2c00ce260 0x7fa2c00cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40036/0 (socket says 172.21.15.37:40036) 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2bf7fe700 1 -- 172.21.15.37:0/4105630026 learned_addr learned my addr 172.21.15.37:0/4105630026 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.557+0000 7fa2c4e33700 1 --2- 172.21.15.37:0/4105630026 >> v2:172.21.15.83:3300/0 conn(0x7fa2c00ceff0 0x7fa2c00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2bf7fe700 1 -- 172.21.15.37:0/4105630026 >> v2:172.21.15.83:3300/0 conn(0x7fa2c00ceff0 msgr2=0x7fa2c00cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2bf7fe700 1 --2- 172.21.15.37:0/4105630026 >> v2:172.21.15.83:3300/0 conn(0x7fa2c00ceff0 0x7fa2c00cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2bf7fe700 1 -- 172.21.15.37:0/4105630026 >> v1:172.21.15.83:6789/0 conn(0x7fa2c0159dc0 legacy=0x7fa2c00ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2bf7fe700 1 -- 172.21.15.37:0/4105630026 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00c5430 con 0x7fa2c00ce260 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2bf7fe700 1 --2- 172.21.15.37:0/4105630026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c00ce260 0x7fa2c00cc6a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2c008a9b0 tx=0x7fa2a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faec1e25dbb1fc81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2beffd700 1 -- 172.21.15.37:0/4105630026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800b860 con 0x7fa2c00ce260 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2beffd700 1 -- 172.21.15.37:0/4105630026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a800b9c0 con 0x7fa2c00ce260 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2beffd700 1 -- 172.21.15.37:0/4105630026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800bd60 con 0x7fa2c00ce260 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 -- 172.21.15.37:0/4105630026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c00ce260 msgr2=0x7fa2c00cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 --2- 172.21.15.37:0/4105630026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c00ce260 0x7fa2c00cc6a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2c008a9b0 tx=0x7fa2a8009250 comp rx=0 tx=0).stop 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 -- 172.21.15.37:0/4105630026 shutdown_connections 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 --2- 172.21.15.37:0/4105630026 >> v2:172.21.15.83:3300/0 conn(0x7fa2c00ceff0 0x7fa2c00cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 --2- 172.21.15.37:0/4105630026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c00ce260 0x7fa2c00cc6a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 -- 172.21.15.37:0/4105630026 >> 172.21.15.37:0/4105630026 conn(0x7fa2c0099a50 msgr2=0x7fa2c006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.558+0000 7fa2c6896700 1 -- 172.21.15.37:0/4105630026 shutdown_connections 2023-10-06T04:17:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.559+0000 7fa2c6896700 1 -- 172.21.15.37:0/4105630026 wait complete. 2023-10-06T04:17:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 Processor -- start 2023-10-06T04:17:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 -- start start 2023-10-06T04:17:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2c00ce260 0x7fa2c00af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2c00ceff0 0x7fa2c0157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b0680 con 0x7fa2c0159dc0 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b2750 con 0x7fa2c00ceff0 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.560+0000 7fa2c6896700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00b0030 con 0x7fa2c00ce260 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40050/0 (socket says 172.21.15.37:40050) 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 -- 172.21.15.37:0/2834883270 learned_addr learned my addr 172.21.15.37:0/2834883270 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2bffff700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2c00ce260 0x7fa2c00af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2bf7fe700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2c00ceff0 0x7fa2c0157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 -- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2c00ce260 msgr2=0x7fa2c00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2c00ce260 0x7fa2c00af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 -- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2c00ceff0 msgr2=0x7fa2c0157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2c00ceff0 0x7fa2c0157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 -- 172.21.15.37:0/2834883270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80094f0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c4e33700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009fa0 tx=0x7fa2b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800ebc0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b800ed20 con 0x7fa2c0159dc0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00b0310 con 0x7fa2c0159dc0 2023-10-06T04:17:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8014670 con 0x7fa2c0159dc0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.561+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00c98a0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.562+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c00b07f0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.563+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2b80149e0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.563+0000 7fa2b7fff700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.563+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa2b8084d30 con 0x7fa2c0159dc0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.563+0000 7fa2bffff700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.564+0000 7fa2bffff700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007fd0 tx=0x7fa2b0007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.567+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2b8051e40 con 0x7fa2c0159dc0 2023-10-06T04:17:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.762+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2c004c3c0 con 0x7fa2c0159dc0 2023-10-06T04:17:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.763+0000 7fa2b7fff700 1 -- 172.21.15.37:0/2834883270 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2b8055460 con 0x7fa2c0159dc0 2023-10-06T04:17:09.766 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 msgr2=0x7fa2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007fd0 tx=0x7fa2b0007eb0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 msgr2=0x7fa2c00cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009fa0 tx=0x7fa2b8009900 comp rx=0 tx=0).stop 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 shutdown_connections 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2c0159dc0 0x7fa2c00cc090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2c00ce260 0x7fa2c00af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 --2- 172.21.15.37:0/2834883270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2c00ceff0 0x7fa2c0157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 >> 172.21.15.37:0/2834883270 conn(0x7fa2c0099a50 msgr2=0x7fa2c00ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 shutdown_connections 2023-10-06T04:17:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.765+0000 7fa2c6896700 1 -- 172.21.15.37:0/2834883270 wait complete. 2023-10-06T04:17:09.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.899+0000 7fbd5599d700 1 Processor -- start 2023-10-06T04:17:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.899+0000 7fbd5599d700 1 -- start start 2023-10-06T04:17:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500af0d0 0x7fbd5006c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5599d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd50068d80 0x7fbd500c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5599d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500aec40 con 0x7fbd500c8650 2023-10-06T04:17:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5599d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500ae310 con 0x7fbd50068d80 2023-10-06T04:17:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500ae5f0 con 0x7fbd500af0d0 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5499b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd500c8650 0x7fbd50068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58500/0 (socket says 172.21.15.37:58500) 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5499b700 1 -- 172.21.15.37:0/4277107964 learned_addr learned my addr 172.21.15.37:0/4277107964 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.900+0000 7fbd5519c700 1 --2- 172.21.15.37:0/4277107964 >> v2:172.21.15.37:3300/0 conn(0x7fbd50068d80 0x7fbd500c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4ffff700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500af0d0 0x7fbd5006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4f7fe700 1 -- 172.21.15.37:0/4277107964 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360284330 0 0) 0x7fbd500aec40 con 0x7fbd500c8650 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4f7fe700 1 -- 172.21.15.37:0/4277107964 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd3c003570 con 0x7fbd500c8650 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd5519c700 1 -- 172.21.15.37:0/4277107964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500af0d0 msgr2=0x7fbd5006c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd5519c700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500af0d0 0x7fbd5006c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd5519c700 1 -- 172.21.15.37:0/4277107964 >> v1:172.21.15.37:6789/0 conn(0x7fbd500c8650 legacy=0x7fbd50068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd5519c700 1 -- 172.21.15.37:0/4277107964 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500ae8d0 con 0x7fbd50068d80 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd5519c700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd500c6ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd380098e0 tx=0x7fbd380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3322359ec95494b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4f7fe700 1 -- 172.21.15.37:0/4277107964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800b640 con 0x7fbd50068d80 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4f7fe700 1 -- 172.21.15.37:0/4277107964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800b7a0 con 0x7fbd50068d80 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.901+0000 7fbd4f7fe700 1 -- 172.21.15.37:0/4277107964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800bb40 con 0x7fbd50068d80 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 -- 172.21.15.37:0/4277107964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 msgr2=0x7fbd500c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd500c6ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd380098e0 tx=0x7fbd380091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 -- 172.21.15.37:0/4277107964 shutdown_connections 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd500c6ec0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4277107964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500af0d0 0x7fbd5006c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 -- 172.21.15.37:0/4277107964 >> 172.21.15.37:0/4277107964 conn(0x7fbd500c9e60 msgr2=0x7fbd5006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 -- 172.21.15.37:0/4277107964 shutdown_connections 2023-10-06T04:17:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.902+0000 7fbd5599d700 1 -- 172.21.15.37:0/4277107964 wait complete. 2023-10-06T04:17:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.903+0000 7fbd5599d700 1 Processor -- start 2023-10-06T04:17:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.903+0000 7fbd5599d700 1 -- start start 2023-10-06T04:17:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd500af0d0 0x7fbd500c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500c8650 0x7fbd5016de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50156930 con 0x7fbd50068d80 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500c58f0 con 0x7fbd500af0d0 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd500c5bd0 con 0x7fbd500c8650 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40062/0 (socket says 172.21.15.37:40062) 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 -- 172.21.15.37:0/4153977729 learned_addr learned my addr 172.21.15.37:0/4153977729 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd4ffff700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd500af0d0 0x7fbd500c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5519c700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500c8650 0x7fbd5016de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 -- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500c8650 msgr2=0x7fbd5016de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500c8650 0x7fbd5016de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 -- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd500af0d0 msgr2=0x7fbd500c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd500af0d0 0x7fbd500c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 -- 172.21.15.37:0/4153977729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009420 con 0x7fbd50068d80 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5499b700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c590 tx=0x7fbd48007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48005b30 con 0x7fbd50068d80 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48005cb0 con 0x7fbd50068d80 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd500c5f10 con 0x7fbd50068d80 2023-10-06T04:17:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48007320 con 0x7fbd50068d80 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.904+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd500c5530 con 0x7fbd50068d80 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.905+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5004c3c0 con 0x7fbd50068d80 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.906+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd4801b3b0 con 0x7fbd50068d80 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.906+0000 7fbd4cff9700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.906+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd48083b10 con 0x7fbd50068d80 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.906+0000 7fbd4ffff700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.907+0000 7fbd4ffff700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fd0 tx=0x7fbd40009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:09.911+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd48050c20 con 0x7fbd50068d80 2023-10-06T04:17:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.104+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbd5006c170 con 0x7fbd50068d80 2023-10-06T04:17:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.104+0000 7fbd4cff9700 1 -- 172.21.15.37:0/4153977729 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbd48017020 con 0x7fbd50068d80 2023-10-06T04:17:10.107 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 msgr2=0x7fbd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fd0 tx=0x7fbd40009880 comp rx=0 tx=0).stop 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 msgr2=0x7fbd5015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c590 tx=0x7fbd48007e00 comp rx=0 tx=0).stop 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 shutdown_connections 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd500c8650 0x7fbd5016de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd50068d80 0x7fbd5015c110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 --2- 172.21.15.37:0/4153977729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd500af0d0 0x7fbd500c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 >> 172.21.15.37:0/4153977729 conn(0x7fbd500c9e60 msgr2=0x7fbd50156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 shutdown_connections 2023-10-06T04:17:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.106+0000 7fbd5599d700 1 -- 172.21.15.37:0/4153977729 wait complete. 2023-10-06T04:17:10.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:10.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.239+0000 7f7c4985d700 1 Processor -- start 2023-10-06T04:17:10.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.239+0000 7f7c4985d700 1 -- start start 2023-10-06T04:17:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4985d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c44153d90 0x7f7c44159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4985d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 0x7f7c440d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4985d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440b51a0 con 0x7f7c441539c0 2023-10-06T04:17:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4985d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440d0cc0 con 0x7f7c44153d90 2023-10-06T04:17:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4985d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440b5ff0 con 0x7f7c440d02e0 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c44153d90 0x7f7c44159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c44153d90 0x7f7c44159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40070/0 (socket says 172.21.15.37:40070) 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 -- 172.21.15.37:0/1018835955 learned_addr learned my addr 172.21.15.37:0/1018835955 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4905c700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 0x7f7c440d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 -- 172.21.15.37:0/1018835955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 msgr2=0x7f7c440d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 0x7f7c440d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 -- 172.21.15.37:0/1018835955 >> v1:172.21.15.83:6789/0 conn(0x7f7c441539c0 legacy=0x7f7c440b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c43fff700 1 -- 172.21.15.37:0/1018835955 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440b53e0 con 0x7f7c44153d90 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.240+0000 7f7c4905c700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 0x7f7c440d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c43fff700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c44153d90 0x7f7c44159b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0099b0 tx=0x7f7c2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc62567b66d746b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c437fe700 1 -- 172.21.15.37:0/1018835955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00b860 con 0x7f7c44153d90 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c437fe700 1 -- 172.21.15.37:0/1018835955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00b9c0 con 0x7f7c44153d90 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c437fe700 1 -- 172.21.15.37:0/1018835955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00bd60 con 0x7f7c44153d90 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 -- 172.21.15.37:0/1018835955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c44153d90 msgr2=0x7f7c44159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c44153d90 0x7f7c44159b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0099b0 tx=0x7f7c2c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 -- 172.21.15.37:0/1018835955 shutdown_connections 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c440d02e0 0x7f7c440d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 --2- 172.21.15.37:0/1018835955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c44153d90 0x7f7c44159b00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 -- 172.21.15.37:0/1018835955 >> 172.21.15.37:0/1018835955 conn(0x7f7c4406ed90 msgr2=0x7f7c4406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 -- 172.21.15.37:0/1018835955 shutdown_connections 2023-10-06T04:17:10.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.241+0000 7f7c4985d700 1 -- 172.21.15.37:0/1018835955 wait complete. 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.242+0000 7f7c4985d700 1 Processor -- start 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 -- start start 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c440d02e0 0x7f7c44155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c44153d90 0x7f7c44169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440af000 con 0x7f7c441539c0 2023-10-06T04:17:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44154e80 con 0x7f7c440d02e0 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4985d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c441542b0 con 0x7f7c44153d90 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40076/0 (socket says 172.21.15.37:40076) 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c43fff700 1 -- 172.21.15.37:0/3811447209 learned_addr learned my addr 172.21.15.37:0/3811447209 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4905c700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c44153d90 0x7f7c44169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.243+0000 7f7c4885b700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c440d02e0 0x7f7c44155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 -- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c44153d90 msgr2=0x7f7c44169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c44153d90 0x7f7c44169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 -- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c440d02e0 msgr2=0x7f7c44155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c440d02e0 0x7f7c44155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 -- 172.21.15.37:0/3811447209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0094f0 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c43fff700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009290 tx=0x7f7c2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c011dc0 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c01f070 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44154550 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0266d0 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.244+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44154b10 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.245+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4404c3c0 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.245+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2c026a40 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.246+0000 7f7c40ff9700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.246+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c2c021070 con 0x7f7c441539c0 2023-10-06T04:17:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.246+0000 7f7c4885b700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.246+0000 7f7c4885b700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 0x7f7c240693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c007fd0 tx=0x7f7c3c0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.250+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c2c053570 con 0x7f7c441539c0 2023-10-06T04:17:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.441+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c44154fc0 con 0x7f7c441539c0 2023-10-06T04:17:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.441+0000 7f7c40ff9700 1 -- 172.21.15.37:0/3811447209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c2c056b90 con 0x7f7c441539c0 2023-10-06T04:17:10.444 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 msgr2=0x7f7c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 0x7f7c240693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c007fd0 tx=0x7f7c3c0016f0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 msgr2=0x7f7c44169870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009290 tx=0x7f7c2c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 shutdown_connections 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c44153d90 0x7f7c44169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7c24066f30 0x7f7c240693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c440d02e0 0x7f7c44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 --2- 172.21.15.37:0/3811447209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c441539c0 0x7f7c44169870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.443+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 >> 172.21.15.37:0/3811447209 conn(0x7f7c4406ed90 msgr2=0x7f7c44152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.444+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 shutdown_connections 2023-10-06T04:17:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.444+0000 7f7c4985d700 1 -- 172.21.15.37:0/3811447209 wait complete. 2023-10-06T04:17:10.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:10.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 Processor -- start 2023-10-06T04:17:10.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 -- start start 2023-10-06T04:17:10.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed640ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fed640ce260 0x7fed640ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed640cdb20 con 0x7fed640cf530 2023-10-06T04:17:10.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640cf9d0 con 0x7fed640ce260 2023-10-06T04:17:10.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.578+0000 7fed69bbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b3090 con 0x7fed64159dc0 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed63fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed640cf530 0x7fed640c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58510/0 (socket says 172.21.15.37:58510) 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed63fff700 1 -- 172.21.15.37:0/388826539 learned_addr learned my addr 172.21.15.37:0/388826539 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed62ffd700 1 --2- 172.21.15.37:0/388826539 >> v2:172.21.15.83:3300/0 conn(0x7fed640ce260 0x7fed640ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed637fe700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed640ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397608205 0 0) 0x7fed640cdb20 con 0x7fed640cf530 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed4c003570 con 0x7fed640cf530 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3648452107 0 0) 0x7fed4c003570 con 0x7fed640cf530 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 msgr2=0x7fed640ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed640ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 >> v2:172.21.15.83:3300/0 conn(0x7fed640ce260 msgr2=0x7fed640ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 --2- 172.21.15.37:0/388826539 >> v2:172.21.15.83:3300/0 conn(0x7fed640ce260 0x7fed640ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640c5430 con 0x7fed640cf530 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fed5c0017f0 con 0x7fed640cf530 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 >> v1:172.21.15.37:6789/0 conn(0x7fed640cf530 legacy=0x7fed640c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640cf9d0 con 0x7fed4c003a60 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b3090 con 0x7fed4c004810 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c00ba60 con 0x7fed64159dc0 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed637fe700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed62ffd700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.579+0000 7fed63fff700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 -- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 msgr2=0x7fed4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 -- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 msgr2=0x7fed4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed4c004810 0x7fed4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 -- 172.21.15.37:0/388826539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c003570 con 0x7fed4c003a60 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed63fff700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed64159dc0 0x7fed4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed637fe700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fed54009c20 tx=0x7fed54009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e447d5a93f1cfa25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54005a00 con 0x7fed4c003a60 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54005b60 con 0x7fed4c003a60 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed627fc700 1 -- 172.21.15.37:0/388826539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400e710 con 0x7fed4c003a60 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 -- 172.21.15.37:0/388826539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 msgr2=0x7fed4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 --2- 172.21.15.37:0/388826539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed4c003e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fed54009c20 tx=0x7fed54009120 comp rx=0 tx=0).stop 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed63fff700 1 -- 172.21.15.37:0/388826539 reap_dead start 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 -- 172.21.15.37:0/388826539 shutdown_connections 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 -- 172.21.15.37:0/388826539 >> 172.21.15.37:0/388826539 conn(0x7fed64099a50 msgr2=0x7fed6406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 -- 172.21.15.37:0/388826539 shutdown_connections 2023-10-06T04:17:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.580+0000 7fed69bbf700 1 -- 172.21.15.37:0/388826539 wait complete. 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 Processor -- start 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 -- start start 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 0x7fed64157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 0x7fed640cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640cc800 con 0x7fed4c003a60 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64158400 con 0x7fed64157980 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed69bbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed641586e0 con 0x7fed640cbe50 2023-10-06T04:17:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40084/0 (socket says 172.21.15.37:40084) 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.582+0000 7fed637fe700 1 -- 172.21.15.37:0/2077510283 learned_addr learned my addr 172.21.15.37:0/2077510283 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed63fff700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 0x7fed640cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed62ffd700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 0x7fed64157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 -- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 msgr2=0x7fed640cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 0x7fed640cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 -- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 msgr2=0x7fed64157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 0x7fed64157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 -- 172.21.15.37:0/2077510283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed641589c0 con 0x7fed4c003a60 2023-10-06T04:17:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed63fff700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 0x7fed640cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed62ffd700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 0x7fed64157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed637fe700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0046d0 tx=0x7fed54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54006310 con 0x7fed4c003a60 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54006490 con 0x7fed4c003a60 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed64158ca0 con 0x7fed4c003a60 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54006850 con 0x7fed4c003a60 2023-10-06T04:17:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.583+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64155de0 con 0x7fed4c003a60 2023-10-06T04:17:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.584+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6409b6f0 con 0x7fed4c003a60 2023-10-06T04:17:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.585+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed54013680 con 0x7fed4c003a60 2023-10-06T04:17:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.585+0000 7fed4b7fe700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.585+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed54085dd0 con 0x7fed4c003a60 2023-10-06T04:17:10.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.585+0000 7fed62ffd700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.586+0000 7fed62ffd700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 0x7fed500693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed58006dc0 tx=0x7fed58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.589+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed54052ee0 con 0x7fed4c003a60 2023-10-06T04:17:10.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.780+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed6404c3c0 con 0x7fed4c003a60 2023-10-06T04:17:10.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.780+0000 7fed4b7fe700 1 -- 172.21.15.37:0/2077510283 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed54056500 con 0x7fed4c003a60 2023-10-06T04:17:10.783 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 msgr2=0x7fed500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 0x7fed500693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fed58006dc0 tx=0x7fed58008040 comp rx=0 tx=0).stop 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 msgr2=0x7fed64153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0046d0 tx=0x7fed54019000 comp rx=0 tx=0).stop 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 shutdown_connections 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fed640cbe50 0x7fed640cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c003a60 0x7fed64153720 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 --2- 172.21.15.37:0/2077510283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed64157980 0x7fed64157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 >> 172.21.15.37:0/2077510283 conn(0x7fed64099a50 msgr2=0x7fed640ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 shutdown_connections 2023-10-06T04:17:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.783+0000 7fed69bbf700 1 -- 172.21.15.37:0/2077510283 wait complete. 2023-10-06T04:17:10.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:10.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.913+0000 7f1b3c10b700 1 Processor -- start 2023-10-06T04:17:10.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.914+0000 7f1b3c10b700 1 -- start start 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.914+0000 7f1b3c10b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1b340b4930 0x7f1b34164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3c10b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340b6530 con 0x7f1b340cfbb0 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3c10b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340ce710 con 0x7f1b340b3740 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3c10b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b34159e20 con 0x7f1b340b4930 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b396a6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b340cfbb0 0x7f1b340b4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58514/0 (socket says 172.21.15.37:58514) 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b396a6700 1 -- 172.21.15.37:0/2493965672 learned_addr learned my addr 172.21.15.37:0/2493965672 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3a6a8700 1 --2- 172.21.15.37:0/2493965672 >> v2:172.21.15.83:3300/0 conn(0x7f1b340b4930 0x7f1b34164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533320153 0 0) 0x7f1b340b6530 con 0x7f1b340cfbb0 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1c003570 con 0x7f1b340cfbb0 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442648492 0 0) 0x7f1b1c003570 con 0x7f1b340cfbb0 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/2493965672 >> v1:172.21.15.83:6789/0 conn(0x7f1b340b3740 legacy=0x7f1b340b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/2493965672 >> v1:172.21.15.37:6789/0 conn(0x7f1b340cfbb0 legacy=0x7f1b340b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/2493965672 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340cdb00 con 0x7f1b340b4930 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b3a6a8700 1 --2- 172.21.15.37:0/2493965672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b4930 0x7f1b34164630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009e60 tx=0x7f1b24009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3094fa4fc7280042 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.915+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400e070 con 0x7f1b340b4930 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400b850 con 0x7f1b340b4930 2023-10-06T04:17:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b38ea5700 1 -- 172.21.15.37:0/2493965672 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28001470 con 0x7f1b340b4930 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 -- 172.21.15.37:0/2493965672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b4930 msgr2=0x7f1b34164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/2493965672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b4930 0x7f1b34164630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009e60 tx=0x7f1b24009780 comp rx=0 tx=0).stop 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 -- 172.21.15.37:0/2493965672 shutdown_connections 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/2493965672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b4930 0x7f1b34164630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 -- 172.21.15.37:0/2493965672 >> 172.21.15.37:0/2493965672 conn(0x7f1b34099a10 msgr2=0x7f1b3406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 -- 172.21.15.37:0/2493965672 shutdown_connections 2023-10-06T04:17:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.916+0000 7f1b3c10b700 1 -- 172.21.15.37:0/2493965672 wait complete. 2023-10-06T04:17:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.917+0000 7f1b3c10b700 1 Processor -- start 2023-10-06T04:17:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.917+0000 7f1b3c10b700 1 -- start start 2023-10-06T04:17:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 0x7f1b34156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 0x7f1b340cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3409a4b0 con 0x7f1b340cfbb0 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3415b080 con 0x7f1b340b3740 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3c10b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3415a750 con 0x7f1b340b4930 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40094/0 (socket says 172.21.15.37:40094) 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/3867258837 learned_addr learned my addr 172.21.15.37:0/3867258837 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b396a6700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 0x7f1b340cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b39ea7700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 0x7f1b34156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 msgr2=0x7f1b340cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 0x7f1b340cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 msgr2=0x7f1b34156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 0x7f1b34156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 -- 172.21.15.37:0/3867258837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009a20 con 0x7f1b340cfbb0 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b39ea7700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 0x7f1b34156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b396a6700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 0x7f1b340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.918+0000 7f1b3a6a8700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b34088fa0 tx=0x7f1b24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.919+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24012d80 con 0x7f1b340cfbb0 2023-10-06T04:17:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.919+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2401e450 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.919+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3415aa30 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.919+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401e7f0 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.919+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b341571a0 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.920+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b34063410 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.920+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b2401eb60 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.921+0000 7f1b31ffb700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 0x7f1b200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.921+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b24086ab0 con 0x7f1b340cfbb0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.921+0000 7f1b39ea7700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 0x7f1b200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.921+0000 7f1b39ea7700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 0x7f1b200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0018b0 tx=0x7f1b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:10.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:10.925+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b24053b20 con 0x7f1b340cfbb0 2023-10-06T04:17:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.164+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b3415b1c0 con 0x7f1b340cfbb0 2023-10-06T04:17:11.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.164+0000 7f1b31ffb700 1 -- 172.21.15.37:0/3867258837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f1b24057140 con 0x7f1b340cfbb0 2023-10-06T04:17:11.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:11.167 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 msgr2=0x7f1b200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 0x7f1b200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0018b0 tx=0x7f1b2c009040 comp rx=0 tx=0).stop 2023-10-06T04:17:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 msgr2=0x7f1b340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b34088fa0 tx=0x7f1b24017000 comp rx=0 tx=0).stop 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 shutdown_connections 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b340cfbb0 0x7f1b340cf4f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1b20066f30 0x7f1b200693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b340b3740 0x7f1b34156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 --2- 172.21.15.37:0/3867258837 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b340b4930 0x7f1b340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 >> 172.21.15.37:0/3867258837 conn(0x7f1b34099a10 msgr2=0x7f1b340d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 shutdown_connections 2023-10-06T04:17:11.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.166+0000 7f1b3c10b700 1 -- 172.21.15.37:0/3867258837 wait complete. 2023-10-06T04:17:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:11.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.297+0000 7fab5d5ef700 1 Processor -- start 2023-10-06T04:17:11.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.297+0000 7fab5d5ef700 1 -- start start 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5d5ef700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab580cfeb0 0x7fab580ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5d5ef700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab580cfa20 con 0x7fab580cd2c0 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5d5ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab580cee10 con 0x7fab580b2810 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5d5ef700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580d0310 con 0x7fab580cfeb0 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5cdee700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab580cfeb0 0x7fab580ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab577fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab580cd2c0 0x7fab580b0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58526/0 (socket says 172.21.15.37:58526) 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab577fe700 1 -- 172.21.15.37:0/2678894746 learned_addr learned my addr 172.21.15.37:0/2678894746 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5cdee700 1 -- 172.21.15.37:0/2678894746 >> v1:172.21.15.83:6789/0 conn(0x7fab580b2810 legacy=0x7fab580ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5cdee700 1 -- 172.21.15.37:0/2678894746 >> v1:172.21.15.37:6789/0 conn(0x7fab580cd2c0 legacy=0x7fab580b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5cdee700 1 -- 172.21.15.37:0/2678894746 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580cf0f0 con 0x7fab580cfeb0 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab56ffd700 1 -- 172.21.15.37:0/2678894746 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951982673 0 0) 0x7fab580cfa20 con 0x7fab580cd2c0 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.298+0000 7fab5cdee700 1 --2- 172.21.15.37:0/2678894746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580cfeb0 0x7fab580ce780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab50009e60 tx=0x7fab50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1ae646ef9fa133 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab56ffd700 1 -- 172.21.15.37:0/2678894746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5000e070 con 0x7fab580cfeb0 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab56ffd700 1 -- 172.21.15.37:0/2678894746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5000bc30 con 0x7fab580cfeb0 2023-10-06T04:17:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab56ffd700 1 -- 172.21.15.37:0/2678894746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50012430 con 0x7fab580cfeb0 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 -- 172.21.15.37:0/2678894746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580cfeb0 msgr2=0x7fab580ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/2678894746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580cfeb0 0x7fab580ce780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab50009e60 tx=0x7fab50009780 comp rx=0 tx=0).stop 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 -- 172.21.15.37:0/2678894746 shutdown_connections 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/2678894746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580cfeb0 0x7fab580ce780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 -- 172.21.15.37:0/2678894746 >> 172.21.15.37:0/2678894746 conn(0x7fab5806ed90 msgr2=0x7fab5806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 -- 172.21.15.37:0/2678894746 shutdown_connections 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.299+0000 7fab5d5ef700 1 -- 172.21.15.37:0/2678894746 wait complete. 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.300+0000 7fab5d5ef700 1 Processor -- start 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 -- start start 2023-10-06T04:17:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab580cd2c0 0x7fab58159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab580cfeb0 0x7fab5815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58150b50 con 0x7fab580b2810 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab581529c0 con 0x7fab580cfeb0 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5d5ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab580b4180 con 0x7fab580cd2c0 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab57fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab57fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40106/0 (socket says 172.21.15.37:40106) 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab57fff700 1 -- 172.21.15.37:0/882821370 learned_addr learned my addr 172.21.15.37:0/882821370 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab5cdee700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab580cfeb0 0x7fab5815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.301+0000 7fab577fe700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab580cd2c0 0x7fab58159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 -- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab580cd2c0 msgr2=0x7fab58159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab580cd2c0 0x7fab58159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 -- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab580cfeb0 msgr2=0x7fab5815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab580cfeb0 0x7fab5815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 -- 172.21.15.37:0/882821370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009a20 con 0x7fab580b2810 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab57fff700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c5c0 tx=0x7fab4800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48011590 con 0x7fab580b2810 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab48011710 con 0x7fab580b2810 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab580b3ba0 con 0x7fab580b2810 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48011ad0 con 0x7fab580b2810 2023-10-06T04:17:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.302+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab580b3e10 con 0x7fab580b2810 2023-10-06T04:17:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.303+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5804c3c0 con 0x7fab580b2810 2023-10-06T04:17:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.303+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab4801b3b0 con 0x7fab580b2810 2023-10-06T04:17:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.304+0000 7fab3ffff700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.304+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab48083b30 con 0x7fab580b2810 2023-10-06T04:17:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.304+0000 7fab577fe700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.304+0000 7fab577fe700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab5815cd40 tx=0x7fab4c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.308+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab48050c40 con 0x7fab580b2810 2023-10-06T04:17:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.502+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab580afb30 con 0x7fab580b2810 2023-10-06T04:17:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.503+0000 7fab3ffff700 1 -- 172.21.15.37:0/882821370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fab48017070 con 0x7fab580b2810 2023-10-06T04:17:11.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:11.506 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 msgr2=0x7fab440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab5815cd40 tx=0x7fab4c007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 msgr2=0x7fab58150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c5c0 tx=0x7fab4800c8d0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 shutdown_connections 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab580cfeb0 0x7fab5815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab580b2810 0x7fab58150610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 --2- 172.21.15.37:0/882821370 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab580cd2c0 0x7fab58159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 >> 172.21.15.37:0/882821370 conn(0x7fab5806ed90 msgr2=0x7fab580b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 shutdown_connections 2023-10-06T04:17:11.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.505+0000 7fab5d5ef700 1 -- 172.21.15.37:0/882821370 wait complete. 2023-10-06T04:17:11.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:11.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.639+0000 7f639e619700 1 Processor -- start 2023-10-06T04:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.639+0000 7f639e619700 1 -- start start 2023-10-06T04:17:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639e619700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63981540b0 0x7f6398067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639e619700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63980b1070 0x7f6398067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639e619700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639815a140 con 0x7f639806e7a0 2023-10-06T04:17:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639e619700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639815afa0 con 0x7f63981540b0 2023-10-06T04:17:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639e619700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639815a390 con 0x7f63980b1070 2023-10-06T04:17:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f6397fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63981540b0 0x7f6398067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f63977fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f639806e7a0 0x7f63980b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58532/0 (socket says 172.21.15.37:58532) 2023-10-06T04:17:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f63977fe700 1 -- 172.21.15.37:0/2901405828 learned_addr learned my addr 172.21.15.37:0/2901405828 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f639cbb6700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63980b1070 0x7f6398067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f6397fff700 1 -- 172.21.15.37:0/2901405828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63980b1070 msgr2=0x7f6398067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f6397fff700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63980b1070 0x7f6398067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f6397fff700 1 -- 172.21.15.37:0/2901405828 >> v1:172.21.15.37:6789/0 conn(0x7f639806e7a0 legacy=0x7f63980b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.640+0000 7f6396ffd700 1 -- 172.21.15.37:0/2901405828 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300812971 0 0) 0x7f639815a140 con 0x7f639806e7a0 2023-10-06T04:17:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f6397fff700 1 -- 172.21.15.37:0/2901405828 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639815a670 con 0x7f63981540b0 2023-10-06T04:17:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f6397fff700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63981540b0 0x7f6398067660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63880098e0 tx=0x7f63880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d721e805898b4f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f6396ffd700 1 -- 172.21.15.37:0/2901405828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388009e80 con 0x7f63981540b0 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f6396ffd700 1 -- 172.21.15.37:0/2901405828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800b860 con 0x7f63981540b0 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f6396ffd700 1 -- 172.21.15.37:0/2901405828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800bbe0 con 0x7f63981540b0 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 -- 172.21.15.37:0/2901405828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63981540b0 msgr2=0x7f6398067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63981540b0 0x7f6398067660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63880098e0 tx=0x7f63880091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 -- 172.21.15.37:0/2901405828 shutdown_connections 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63980b1070 0x7f6398067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 --2- 172.21.15.37:0/2901405828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63981540b0 0x7f6398067660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 -- 172.21.15.37:0/2901405828 >> 172.21.15.37:0/2901405828 conn(0x7f6398068770 msgr2=0x7f6398068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 -- 172.21.15.37:0/2901405828 shutdown_connections 2023-10-06T04:17:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.641+0000 7f639e619700 1 -- 172.21.15.37:0/2901405828 wait complete. 2023-10-06T04:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.642+0000 7f639e619700 1 Processor -- start 2023-10-06T04:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 -- start start 2023-10-06T04:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f639806e7a0 0x7f63980af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63981540b0 0x7f6398158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980af750 con 0x7f63980b1070 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980aa350 con 0x7f63981540b0 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639e619700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980aa630 con 0x7f639806e7a0 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f63977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f63977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40124/0 (socket says 172.21.15.37:40124) 2023-10-06T04:17:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f63977fe700 1 -- 172.21.15.37:0/2566779627 learned_addr learned my addr 172.21.15.37:0/2566779627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f6397fff700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f639806e7a0 0x7f63980af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.643+0000 7f639cbb6700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63981540b0 0x7f6398158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 -- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f639806e7a0 msgr2=0x7f63980af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f639806e7a0 0x7f63980af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 -- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63981540b0 msgr2=0x7f6398158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63981540b0 0x7f6398158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 -- 172.21.15.37:0/2566779627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388009420 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f63977fe700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c7e0 tx=0x7f638c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c005b30 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c005c90 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980aa910 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c007300 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.644+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63980acfa0 con 0x7f63980b1070 2023-10-06T04:17:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.645+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639804c3c0 con 0x7f63980b1070 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.646+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f638c01b3b0 con 0x7f63980b1070 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.646+0000 7f637ffff700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.646+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f638c083bb0 con 0x7f63980b1070 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.646+0000 7f6397fff700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.647+0000 7f6397fff700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 0x7f63840693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63880091e0 tx=0x7f6388017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.650+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f638c050cc0 con 0x7f63980b1070 2023-10-06T04:17:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.842+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63980afb60 con 0x7f63980b1070 2023-10-06T04:17:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.842+0000 7f637ffff700 1 -- 172.21.15.37:0/2566779627 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f638c017020 con 0x7f63980b1070 2023-10-06T04:17:11.845 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 msgr2=0x7f63840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 0x7f63840693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63880091e0 tx=0x7f6388017000 comp rx=0 tx=0).stop 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 msgr2=0x7f63980a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c7e0 tx=0x7f638c007df0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 shutdown_connections 2023-10-06T04:17:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6384066f30 0x7f63840693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63981540b0 0x7f6398158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f639806e7a0 0x7f63980af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 --2- 172.21.15.37:0/2566779627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63980b1070 0x7f63980a98d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 >> 172.21.15.37:0/2566779627 conn(0x7f6398068770 msgr2=0x7f639815b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 shutdown_connections 2023-10-06T04:17:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.844+0000 7f639e619700 1 -- 172.21.15.37:0/2566779627 wait complete. 2023-10-06T04:17:11.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.978+0000 7fbfae756700 1 Processor -- start 2023-10-06T04:17:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.978+0000 7fbfae756700 1 -- start start 2023-10-06T04:17:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfae756700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa80b0710 0x7fbfa815be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfae756700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbfa81578d0 0x7fbfa806baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfae756700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa815b420 con 0x7fbfa8157500 2023-10-06T04:17:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfae756700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa815b9e0 con 0x7fbfa80b0710 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfae756700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa8157cf0 con 0x7fbfa81578d0 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfa77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa80b0710 0x7fbfa815be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfa77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa80b0710 0x7fbfa815be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40128/0 (socket says 172.21.15.37:40128) 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfa77fe700 1 -- 172.21.15.37:0/1859475643 learned_addr learned my addr 172.21.15.37:0/1859475643 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.979+0000 7fbfaccf3700 1 --2- 172.21.15.37:0/1859475643 >> v2:172.21.15.83:3300/0 conn(0x7fbfa81578d0 0x7fbfa806baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa77fe700 1 -- 172.21.15.37:0/1859475643 >> v2:172.21.15.83:3300/0 conn(0x7fbfa81578d0 msgr2=0x7fbfa806baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa77fe700 1 --2- 172.21.15.37:0/1859475643 >> v2:172.21.15.83:3300/0 conn(0x7fbfa81578d0 0x7fbfa806baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa77fe700 1 -- 172.21.15.37:0/1859475643 >> v1:172.21.15.83:6789/0 conn(0x7fbfa8157500 legacy=0x7fbfa80b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa77fe700 1 -- 172.21.15.37:0/1859475643 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80b0ba0 con 0x7fbfa80b0710 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa77fe700 1 --2- 172.21.15.37:0/1859475643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa815be70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfa815b380 tx=0x7fbf9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484ec1deb3fa3695 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa6ffd700 1 -- 172.21.15.37:0/1859475643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c009e70 con 0x7fbfa80b0710 2023-10-06T04:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa6ffd700 1 -- 172.21.15.37:0/1859475643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00b860 con 0x7fbfa80b0710 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfa6ffd700 1 -- 172.21.15.37:0/1859475643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00bc00 con 0x7fbfa80b0710 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 -- 172.21.15.37:0/1859475643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 msgr2=0x7fbfa815be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 --2- 172.21.15.37:0/1859475643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa815be70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfa815b380 tx=0x7fbf9c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 -- 172.21.15.37:0/1859475643 shutdown_connections 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 --2- 172.21.15.37:0/1859475643 >> v2:172.21.15.83:3300/0 conn(0x7fbfa81578d0 0x7fbfa806baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 --2- 172.21.15.37:0/1859475643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa815be70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 -- 172.21.15.37:0/1859475643 >> 172.21.15.37:0/1859475643 conn(0x7fbfa80ce680 msgr2=0x7fbfa80cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 -- 172.21.15.37:0/1859475643 shutdown_connections 2023-10-06T04:17:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.980+0000 7fbfae756700 1 -- 172.21.15.37:0/1859475643 wait complete. 2023-10-06T04:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.981+0000 7fbfae756700 1 Processor -- start 2023-10-06T04:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 -- start start 2023-10-06T04:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa8157500 0x7fbfa8157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa81578d0 0x7fbfa8158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815ad60 con 0x7fbfa80b0710 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815b040 con 0x7fbfa8157500 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.982+0000 7fbfae756700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80c6bb0 con 0x7fbfa81578d0 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40142/0 (socket says 172.21.15.37:40142) 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1927550614 learned_addr learned my addr 172.21.15.37:0/1927550614 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfaccf3700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa81578d0 0x7fbfa8158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa81578d0 msgr2=0x7fbfa8158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa77fe700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa8157500 0x7fbfa8157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa81578d0 0x7fbfa8158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa8157500 msgr2=0x7fbfa8157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa8157500 0x7fbfa8157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1927550614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0094f0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c590 tx=0x7fbf9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011590 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf980116f0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa80c6e90 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011ab0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.983+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa8168fa0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.984+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa804c3c0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.984+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf9801b3b0 con 0x7fbfa80b0710 2023-10-06T04:17:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.985+0000 7fbf8ffff700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 0x7fbf940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.985+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf98083c40 con 0x7fbfa80b0710 2023-10-06T04:17:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.985+0000 7fbfa77fe700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 0x7fbf940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.986+0000 7fbfa77fe700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 0x7fbf940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa815b380 tx=0x7fbf9c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:11.989+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf98050d50 con 0x7fbfa80b0710 2023-10-06T04:17:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.182+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfa80b0e80 con 0x7fbfa80b0710 2023-10-06T04:17:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.183+0000 7fbf8ffff700 1 -- 172.21.15.37:0/1927550614 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf98017070 con 0x7fbfa80b0710 2023-10-06T04:17:12.186 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 msgr2=0x7fbf940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 0x7fbf940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfa815b380 tx=0x7fbf9c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 msgr2=0x7fbfa8168a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c590 tx=0x7fbf9800c950 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 shutdown_connections 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa81578d0 0x7fbfa8158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa80b0710 0x7fbfa8168a60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf94066f30 0x7fbf940693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 --2- 172.21.15.37:0/1927550614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa8157500 0x7fbfa8157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 >> 172.21.15.37:0/1927550614 conn(0x7fbfa80ce680 msgr2=0x7fbfa8156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 shutdown_connections 2023-10-06T04:17:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.185+0000 7fbfae756700 1 -- 172.21.15.37:0/1927550614 wait complete. 2023-10-06T04:17:12.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.318+0000 7f1d716e2700 1 Processor -- start 2023-10-06T04:17:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.318+0000 7f1d716e2700 1 -- start start 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d716e2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d716e2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1d6c0a98e0 0x7f1d6c153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d716e2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c15ad40 con 0x7f1d6c068c90 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d716e2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c0a9e50 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d716e2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0aa130 con 0x7f1d6c0688c0 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d70ee1700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d6c068c90 0x7f1d6c153ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58544/0 (socket says 172.21.15.37:58544) 2023-10-06T04:17:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d70ee1700 1 -- 172.21.15.37:0/2154623435 learned_addr learned my addr 172.21.15.37:0/2154623435 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d6b7fe700 1 --2- 172.21.15.37:0/2154623435 >> v2:172.21.15.83:3300/0 conn(0x7f1d6c0a98e0 0x7f1d6c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/2154623435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106915641 0 0) 0x7f1d6c15ad40 con 0x7f1d6c068c90 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.319+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d54003570 con 0x7f1d6c068c90 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56527736 0 0) 0x7f1d54003570 con 0x7f1d6c068c90 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6bfff700 1 -- 172.21.15.37:0/2154623435 >> v2:172.21.15.83:3300/0 conn(0x7f1d6c0a98e0 msgr2=0x7f1d6c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/2154623435 >> v2:172.21.15.83:3300/0 conn(0x7f1d6c0a98e0 0x7f1d6c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6bfff700 1 -- 172.21.15.37:0/2154623435 >> v1:172.21.15.37:6789/0 conn(0x7f1d6c068c90 legacy=0x7f1d6c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6bfff700 1 -- 172.21.15.37:0/2154623435 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0aa410 con 0x7f1d6c0688c0 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/2154623435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c15a800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098e0 tx=0x7f1d5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c51961bdf65dd596 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640017f0 con 0x7f1d6c0688c0 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c011420 con 0x7f1d6c0688c0 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d6affd700 1 -- 172.21.15.37:0/2154623435 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0117c0 con 0x7f1d6c0688c0 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 -- 172.21.15.37:0/2154623435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 msgr2=0x7f1d6c15a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 --2- 172.21.15.37:0/2154623435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c15a800 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098e0 tx=0x7f1d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 -- 172.21.15.37:0/2154623435 shutdown_connections 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 --2- 172.21.15.37:0/2154623435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c15a800 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 --2- 172.21.15.37:0/2154623435 >> v2:172.21.15.83:3300/0 conn(0x7f1d6c0a98e0 0x7f1d6c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.320+0000 7f1d716e2700 1 -- 172.21.15.37:0/2154623435 >> 172.21.15.37:0/2154623435 conn(0x7f1d6c0c9e60 msgr2=0x7f1d6c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.321+0000 7f1d716e2700 1 -- 172.21.15.37:0/2154623435 shutdown_connections 2023-10-06T04:17:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.321+0000 7f1d716e2700 1 -- 172.21.15.37:0/2154623435 wait complete. 2023-10-06T04:17:12.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.322+0000 7f1d716e2700 1 Processor -- start 2023-10-06T04:17:12.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.322+0000 7f1d716e2700 1 -- start start 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.322+0000 7f1d716e2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c16e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.322+0000 7f1d716e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 0x7f1d6c14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b1d20 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b24f0 con 0x7f1d6c068c90 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c16e620 con 0x7f1d6c0688c0 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40156/0 (socket says 172.21.15.37:40156) 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 -- 172.21.15.37:0/3222268483 learned_addr learned my addr 172.21.15.37:0/3222268483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c16e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d6b7fe700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 0x7f1d6c14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 -- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 msgr2=0x7f1d6c16e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c16e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 -- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 msgr2=0x7f1d6c14be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 0x7f1d6c14be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 -- 172.21.15.37:0/3222268483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009420 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d6b7fe700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 0x7f1d6c14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d70ee1700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001560 tx=0x7f1d64001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64004dc0 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400a750 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c0b1f30 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400ab10 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.323+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c155ca0 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.324+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c04c3c0 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.325+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d64007150 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.325+0000 7f1d53fff700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.325+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d64084190 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.325+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.326+0000 7f1d6bfff700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 0x7f1d580693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0030c0 tx=0x7f1d5c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.329+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d64051320 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.521+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d6c06e6b0 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.522+0000 7f1d53fff700 1 -- 172.21.15.37:0/3222268483 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d64054940 con 0x7f1d6c0a98e0 2023-10-06T04:17:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 msgr2=0x7f1d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 0x7f1d580693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0030c0 tx=0x7f1d5c016000 comp rx=0 tx=0).stop 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 msgr2=0x7f1d6c1513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001560 tx=0x7f1d64001640 comp rx=0 tx=0).stop 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 shutdown_connections 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d6c0a98e0 0x7f1d6c1513f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1d6c0688c0 0x7f1d6c16e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1d58066f30 0x7f1d580693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 --2- 172.21.15.37:0/3222268483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d6c068c90 0x7f1d6c14be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 >> 172.21.15.37:0/3222268483 conn(0x7f1d6c0c9e60 msgr2=0x7f1d6c15d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 shutdown_connections 2023-10-06T04:17:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.524+0000 7f1d716e2700 1 -- 172.21.15.37:0/3222268483 wait complete. 2023-10-06T04:17:12.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.657+0000 7f649e98a700 1 Processor -- start 2023-10-06T04:17:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 -- start start 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64980cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64980c43e0 0x7f64980c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980cde60 con 0x7f649815d3d0 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64980c4ad0 con 0x7f64980c43e0 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.658+0000 7f649e98a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980cd2e0 con 0x7f6498159600 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64980c43e0 0x7f64980c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f64977fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f649815d3d0 0x7f64980c3cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58546/0 (socket says 172.21.15.37:58546) 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f64977fe700 1 -- 172.21.15.37:0/2183930620 learned_addr learned my addr 172.21.15.37:0/2183930620 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6497fff700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64980cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6496ffd700 1 -- 172.21.15.37:0/2183930620 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831862647 0 0) 0x7f64980cde60 con 0x7f649815d3d0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6496ffd700 1 -- 172.21.15.37:0/2183930620 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484003570 con 0x7f649815d3d0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 -- 172.21.15.37:0/2183930620 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 msgr2=0x7f64980cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64980cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 -- 172.21.15.37:0/2183930620 >> v1:172.21.15.37:6789/0 conn(0x7f649815d3d0 legacy=0x7f64980c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 -- 172.21.15.37:0/2183930620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980cd5c0 con 0x7f64980c43e0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f649cf27700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f64980c8e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490009e60 tx=0x7f6490009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfdd860d11bf885 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6496ffd700 1 -- 172.21.15.37:0/2183930620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000e070 con 0x7f64980c43e0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6496ffd700 1 -- 172.21.15.37:0/2183930620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649000bab0 con 0x7f64980c43e0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.659+0000 7f6496ffd700 1 -- 172.21.15.37:0/2183930620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000be70 con 0x7f64980c43e0 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 -- 172.21.15.37:0/2183930620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 msgr2=0x7f64980c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f64980c8e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6490009e60 tx=0x7f6490009780 comp rx=0 tx=0).stop 2023-10-06T04:17:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 -- 172.21.15.37:0/2183930620 shutdown_connections 2023-10-06T04:17:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f64980c8e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 --2- 172.21.15.37:0/2183930620 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64980cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 -- 172.21.15.37:0/2183930620 >> 172.21.15.37:0/2183930620 conn(0x7f6498067e40 msgr2=0x7f6498087ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 -- 172.21.15.37:0/2183930620 shutdown_connections 2023-10-06T04:17:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.660+0000 7f649e98a700 1 -- 172.21.15.37:0/2183930620 wait complete. 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.661+0000 7f649e98a700 1 Processor -- start 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.661+0000 7f649e98a700 1 -- start start 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64981528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 0x7f6498152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6498153330 con 0x7f64980c43e0 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981580b0 con 0x7f649815d3d0 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649e98a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6498068b80 con 0x7f6498159600 2023-10-06T04:17:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40180/0 (socket says 172.21.15.37:40180) 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 -- 172.21.15.37:0/473832519 learned_addr learned my addr 172.21.15.37:0/473832519 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649cf27700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 0x7f6498152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f64977fe700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64981528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 -- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 msgr2=0x7f64981528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64981528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 -- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 msgr2=0x7f6498152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 0x7f6498152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f6497fff700 1 -- 172.21.15.37:0/473832519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009a20 con 0x7f64980c43e0 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f649cf27700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 0x7f6498152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.662+0000 7f64977fe700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64981528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f6497fff700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f648800ec80 tx=0x7f6488009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800ca60 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800cbc0 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64981574a0 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488013470 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.663+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6498157a60 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.664+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649804c3c0 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.664+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6488013860 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.665+0000 7f648ffff700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 0x7f6478069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.665+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6488084e40 con 0x7f64980c43e0 2023-10-06T04:17:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.665+0000 7f64977fe700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 0x7f6478069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.666+0000 7f64977fe700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 0x7f6478069410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6480007fd0 tx=0x7f6480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.669+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6488051f50 con 0x7f64980c43e0 2023-10-06T04:17:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.863+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6498158390 con 0x7f64980c43e0 2023-10-06T04:17:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.864+0000 7f648ffff700 1 -- 172.21.15.37:0/473832519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6488055570 con 0x7f64980c43e0 2023-10-06T04:17:12.867 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 msgr2=0x7f6478069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 0x7f6478069410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6480007fd0 tx=0x7f6480009040 comp rx=0 tx=0).stop 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 msgr2=0x7f6498158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f648800ec80 tx=0x7f6488009120 comp rx=0 tx=0).stop 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 shutdown_connections 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6478066f60 0x7f6478069410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f649815d3d0 0x7f6498152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64980c43e0 0x7f6498158540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 --2- 172.21.15.37:0/473832519 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6498159600 0x7f64981528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 >> 172.21.15.37:0/473832519 conn(0x7f6498067e40 msgr2=0x7f6498155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 shutdown_connections 2023-10-06T04:17:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.866+0000 7f649e98a700 1 -- 172.21.15.37:0/473832519 wait complete. 2023-10-06T04:17:12.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:13.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.997+0000 7f66649f2700 1 Processor -- start 2023-10-06T04:17:13.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.997+0000 7f66649f2700 1 -- start start 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.998+0000 7f66649f2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.998+0000 7f66649f2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600ae9f0 con 0x7f66600b6200 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.998+0000 7f66649f2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600adde0 con 0x7f66600ad800 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.998+0000 7f66649f2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66600ae0c0 con 0x7f66600b5e30 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665dd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f66600b6200 0x7f66600ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58558/0 (socket says 172.21.15.37:58558) 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665dd9b700 1 -- 172.21.15.37:0/2454403146 learned_addr learned my addr 172.21.15.37:0/2454403146 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665e59c700 1 --2- 172.21.15.37:0/2454403146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436966028 0 0) 0x7f66600ae9f0 con 0x7f66600b6200 2023-10-06T04:17:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f664c003570 con 0x7f66600b6200 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392787741 0 0) 0x7f66600adde0 con 0x7f66600ad800 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66600ae9f0 con 0x7f66600ad800 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665e59c700 1 -- 172.21.15.37:0/2454403146 >> v1:172.21.15.83:6789/0 conn(0x7f66600ad800 legacy=0x7f66600aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157780753 0 0) 0x7f664c003570 con 0x7f66600b6200 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665e59c700 1 -- 172.21.15.37:0/2454403146 >> v1:172.21.15.37:6789/0 conn(0x7f66600b6200 legacy=0x7f66600ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665e59c700 1 -- 172.21.15.37:0/2454403146 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66600ae3a0 con 0x7f66600b5e30 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665e59c700 1 --2- 172.21.15.37:0/2454403146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666015d560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6658009910 tx=0x7f66580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708bb51b86112823 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:12.999+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648001470 con 0x7f66600b5e30 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658011420 con 0x7f66600b5e30 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f665d59a700 1 -- 172.21.15.37:0/2454403146 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66580117c0 con 0x7f66600b5e30 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 -- 172.21.15.37:0/2454403146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 msgr2=0x7f666015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 --2- 172.21.15.37:0/2454403146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666015d560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6658009910 tx=0x7f66580091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 -- 172.21.15.37:0/2454403146 shutdown_connections 2023-10-06T04:17:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 --2- 172.21.15.37:0/2454403146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666015d560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 -- 172.21.15.37:0/2454403146 >> 172.21.15.37:0/2454403146 conn(0x7f6660099a10 msgr2=0x7f666006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 -- 172.21.15.37:0/2454403146 shutdown_connections 2023-10-06T04:17:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.000+0000 7f66649f2700 1 -- 172.21.15.37:0/2454403146 wait complete. 2023-10-06T04:17:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.001+0000 7f66649f2700 1 Processor -- start 2023-10-06T04:17:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.001+0000 7f66649f2700 1 -- start start 2023-10-06T04:17:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66600ad800 0x7f666014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666016b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 0x7f6660154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666015d070 con 0x7f66600b6200 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666015b110 con 0x7f66600ad800 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f66649f2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66601529d0 con 0x7f66600b5e30 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f665ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 0x7f6660154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f665dd9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666016b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f665e59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66600ad800 0x7f666014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f665ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 0x7f6660154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40186/0 (socket says 172.21.15.37:40186) 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.002+0000 7f665ed9d700 1 -- 172.21.15.37:0/4047986498 learned_addr learned my addr 172.21.15.37:0/4047986498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 -- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66600ad800 msgr2=0x7f666014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66600ad800 0x7f666014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 -- 172.21.15.37:0/4047986498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 msgr2=0x7f6660154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 0x7f6660154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 -- 172.21.15.37:0/4047986498 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6658009420 con 0x7f66600b5e30 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f665dd9b700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666016b030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66480011e0 tx=0x7f6648001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648007360 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66480074c0 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648004830 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6660152c70 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.003+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66601524e0 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.004+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66600b2f90 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.004+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6648004c00 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.005+0000 7f66567fc700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 0x7f66400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.005+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6648084560 con 0x7f66600b5e30 2023-10-06T04:17:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.005+0000 7f665e59c700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 0x7f66400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.005+0000 7f665e59c700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 0x7f66400693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66580030c0 tx=0x7f6658016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.010+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6648051650 con 0x7f66600b5e30 2023-10-06T04:17:13.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.247+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f666015b280 con 0x7f66600b5e30 2023-10-06T04:17:13.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.249+0000 7f66567fc700 1 -- 172.21.15.37:0/4047986498 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f6648054c70 con 0x7f66600b5e30 2023-10-06T04:17:13.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 msgr2=0x7f66400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 0x7f66400693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66580030c0 tx=0x7f6658016000 comp rx=0 tx=0).stop 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 msgr2=0x7f666016b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666016b030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66480011e0 tx=0x7f6648001a30 comp rx=0 tx=0).stop 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 shutdown_connections 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66600b6200 0x7f6660154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6640066f30 0x7f66400693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66600ad800 0x7f666014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 --2- 172.21.15.37:0/4047986498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f66600b5e30 0x7f666016b030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 >> 172.21.15.37:0/4047986498 conn(0x7f6660099a10 msgr2=0x7f66601591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 shutdown_connections 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.250+0000 7f66649f2700 1 -- 172.21.15.37:0/4047986498 wait complete. 2023-10-06T04:17:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:13.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.380+0000 7f832362e700 1 Processor -- start 2023-10-06T04:17:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 -- start start 2023-10-06T04:17:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 0x7f831c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f831c0b6200 0x7f831c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 0x7f831c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0ae9f0 con 0x7f831c0b6200 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0adde0 con 0x7f831c0b5e30 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.381+0000 7f832362e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0ae0c0 con 0x7f831c0ad0f0 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f831c0b6200 0x7f831c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f831c0b6200 0x7f831c15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40200/0 (socket says 172.21.15.37:40200) 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 -- 172.21.15.37:0/791649905 learned_addr learned my addr 172.21.15.37:0/791649905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f83213ca700 1 --2- 172.21.15.37:0/791649905 >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 0x7f831c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8321bcb700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 0x7f831c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 -- 172.21.15.37:0/791649905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 msgr2=0x7f831c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 0x7f831c0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 -- 172.21.15.37:0/791649905 >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 msgr2=0x7f831c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 --2- 172.21.15.37:0/791649905 >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 0x7f831c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 -- 172.21.15.37:0/791649905 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0ae3a0 con 0x7f831c0b6200 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8321bcb700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 0x7f831c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f83213ca700 1 --2- 172.21.15.37:0/791649905 >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 0x7f831c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f8320bc9700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0b6200 0x7f831c15daa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f831c064840 tx=0x7f8310009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14a72d9b84d3201 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f831bfff700 1 -- 172.21.15.37:0/791649905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000b860 con 0x7f831c0b6200 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f831bfff700 1 -- 172.21.15.37:0/791649905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000b9c0 con 0x7f831c0b6200 2023-10-06T04:17:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.382+0000 7f831bfff700 1 -- 172.21.15.37:0/791649905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000bd80 con 0x7f831c0b6200 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 -- 172.21.15.37:0/791649905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0b6200 msgr2=0x7f831c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0b6200 0x7f831c15daa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f831c064840 tx=0x7f8310009250 comp rx=0 tx=0).stop 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 -- 172.21.15.37:0/791649905 shutdown_connections 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0ad0f0 0x7f831c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 --2- 172.21.15.37:0/791649905 >> v2:172.21.15.83:3300/0 conn(0x7f831c0b5e30 0x7f831c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 --2- 172.21.15.37:0/791649905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0b6200 0x7f831c15daa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 -- 172.21.15.37:0/791649905 >> 172.21.15.37:0/791649905 conn(0x7f831c099a10 msgr2=0x7f831c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 -- 172.21.15.37:0/791649905 shutdown_connections 2023-10-06T04:17:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.383+0000 7f832362e700 1 -- 172.21.15.37:0/791649905 wait complete. 2023-10-06T04:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.384+0000 7f832362e700 1 Processor -- start 2023-10-06T04:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.384+0000 7f832362e700 1 -- start start 2023-10-06T04:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 0x7f831c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 0x7f831c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c150f80 con 0x7f831c0ad0f0 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c15cd90 con 0x7f831c0b6200 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f832362e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c15b290 con 0x7f831c0b5e30 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40202/0 (socket says 172.21.15.37:40202) 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 -- 172.21.15.37:0/2050241164 learned_addr learned my addr 172.21.15.37:0/2050241164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f8320bc9700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 0x7f831c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f8321bcb700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 0x7f831c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 -- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 msgr2=0x7f831c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 0x7f831c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 -- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 msgr2=0x7f831c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 0x7f831c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 -- 172.21.15.37:0/2050241164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094f0 con 0x7f831c0ad0f0 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f8320bc9700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 0x7f831c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f8321bcb700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 0x7f831c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.385+0000 7f83213ca700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f831400e850 tx=0x7f8314008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.386+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314013410 con 0x7f831c0ad0f0 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.386+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314013570 con 0x7f831c0ad0f0 2023-10-06T04:17:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.386+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c15b570 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.386+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314013910 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.386+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c15bb30 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.387+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c0b2f90 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.387+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8314013d00 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.387+0000 7f83197fa700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.387+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8314084380 con 0x7f831c0ad0f0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.388+0000 7f8320bc9700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.388+0000 7f8320bc9700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 0x7f83080693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f831c064840 tx=0x7f8310017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.392+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8314051490 con 0x7f831c0ad0f0 2023-10-06T04:17:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.588+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f831c063410 con 0x7f831c0ad0f0 2023-10-06T04:17:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.589+0000 7f83197fa700 1 -- 172.21.15.37:0/2050241164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f8314054ab0 con 0x7f831c0ad0f0 2023-10-06T04:17:13.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:13.592 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:13.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 msgr2=0x7f83080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 0x7f83080693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f831c064840 tx=0x7f8310017000 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 msgr2=0x7f831c15acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f831400e850 tx=0x7f8314008040 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 shutdown_connections 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8308066f30 0x7f83080693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f831c0b6200 0x7f831c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c0ad0f0 0x7f831c15acb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 --2- 172.21.15.37:0/2050241164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f831c0b5e30 0x7f831c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 >> 172.21.15.37:0/2050241164 conn(0x7f831c099a10 msgr2=0x7f831c156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 shutdown_connections 2023-10-06T04:17:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.591+0000 7f832362e700 1 -- 172.21.15.37:0/2050241164 wait complete. 2023-10-06T04:17:13.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.722+0000 7f28d90fa700 1 Processor -- start 2023-10-06T04:17:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.722+0000 7f28d90fa700 1 -- start start 2023-10-06T04:17:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d90fa700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f28d40b2810 0x7f28d40cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d90fa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40cfa20 con 0x7f28d40cd2c0 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d90fa700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40cee10 con 0x7f28d40ce780 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d90fa700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40cec20 con 0x7f28d40b2810 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d88f9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28d40cd2c0 0x7f28d40b0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58560/0 (socket says 172.21.15.37:58560) 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d88f9700 1 -- 172.21.15.37:0/1757613069 learned_addr learned my addr 172.21.15.37:0/1757613069 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1757613069 >> v2:172.21.15.83:3300/0 conn(0x7f28d40b2810 0x7f28d40cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749893759 0 0) 0x7f28d40cfa20 con 0x7f28d40cd2c0 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c0003570 con 0x7f28d40cd2c0 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4230500278 0 0) 0x7f28c0003570 con 0x7f28d40cd2c0 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 >> v2:172.21.15.83:3300/0 conn(0x7f28d40b2810 msgr2=0x7f28d40cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 --2- 172.21.15.37:0/1757613069 >> v2:172.21.15.83:3300/0 conn(0x7f28d40b2810 0x7f28d40cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 >> v1:172.21.15.83:6789/0 conn(0x7f28d40ce780 legacy=0x7f28d40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40cf0f0 con 0x7f28d40cd2c0 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.723+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f28cc0017f0 con 0x7f28d40cd2c0 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 >> v1:172.21.15.37:6789/0 conn(0x7f28d40cd2c0 legacy=0x7f28d40b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 0x7f28c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c00051c0 0x7f28c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000c0a0 con 0x7f28c0003a60 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000c210 con 0x7f28c0004810 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c000c3d0 con 0x7f28c00051c0 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 0x7f28c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d37fe700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d88f9700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c00051c0 0x7f28c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 -- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c00051c0 msgr2=0x7f28c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c00051c0 0x7f28c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 -- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28c0004810 msgr2=0x7f28c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28c0004810 0x7f28c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 -- 172.21.15.37:0/1757613069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0003570 con 0x7f28c0003a60 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d88f9700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c00051c0 0x7f28c000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d88f9700 1 -- 172.21.15.37:0/1757613069 reap_dead start 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 0x7f28c0003e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009c00 tx=0x7f28bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdf8126adb30afd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00e710 con 0x7f28c0003a60 2023-10-06T04:17:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00e870 con 0x7f28c0003a60 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.724+0000 7f28d2ffd700 1 -- 172.21.15.37:0/1757613069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00ec30 con 0x7f28c0003a60 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 -- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 msgr2=0x7f28c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 0x7f28c0003e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009c00 tx=0x7f28bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 -- 172.21.15.37:0/1757613069 shutdown_connections 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1757613069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c0003a60 0x7f28c0003e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 -- 172.21.15.37:0/1757613069 >> 172.21.15.37:0/1757613069 conn(0x7f28d406ed90 msgr2=0x7f28d406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 -- 172.21.15.37:0/1757613069 shutdown_connections 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.725+0000 7f28d90fa700 1 -- 172.21.15.37:0/1757613069 wait complete. 2023-10-06T04:17:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.726+0000 7f28d90fa700 1 Processor -- start 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.726+0000 7f28d90fa700 1 -- start start 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c0003a60 0x7f28d415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28d4156bb0 0x7f28d4157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40c8a10 con 0x7f28d40b43b0 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415b450 con 0x7f28d4156bb0 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d90fa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415a610 con 0x7f28c0003a60 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40210/0 (socket says 172.21.15.37:40210) 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 -- 172.21.15.37:0/1685206704 learned_addr learned my addr 172.21.15.37:0/1685206704 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c0003a60 0x7f28d415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d88f9700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28d4156bb0 0x7f28d4157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 -- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c0003a60 msgr2=0x7f28d415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c0003a60 0x7f28d415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 -- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28d4156bb0 msgr2=0x7f28d4157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28d4156bb0 0x7f28d4157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 -- 172.21.15.37:0/1685206704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d415a8f0 con 0x7f28d40b43b0 2023-10-06T04:17:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.727+0000 7f28d37fe700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28c4002950 tx=0x7f28c4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4006820 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4006980 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d415abd0 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4006d40 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d40b5fc0 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.728+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d404c3c0 con 0x7f28d40b43b0 2023-10-06T04:17:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.729+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28c4007230 con 0x7f28d40b43b0 2023-10-06T04:17:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.729+0000 7f28cbfff700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.729+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28c4084550 con 0x7f28d40b43b0 2023-10-06T04:17:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.730+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.730+0000 7f28d3fff700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 0x7f28b40693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0091e0 tx=0x7f28bc01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.734+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28c4051720 con 0x7f28d40b43b0 2023-10-06T04:17:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.976+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d40afb30 con 0x7f28d40b43b0 2023-10-06T04:17:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.976+0000 7f28cbfff700 1 -- 172.21.15.37:0/1685206704 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f28c4054d40 con 0x7f28d40b43b0 2023-10-06T04:17:13.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:13.979 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.978+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 msgr2=0x7f28b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.978+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 0x7f28b40693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0091e0 tx=0x7f28bc01a000 comp rx=0 tx=0).stop 2023-10-06T04:17:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.978+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 msgr2=0x7f28d40c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.978+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28c4002950 tx=0x7f28c4007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 shutdown_connections 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f28b4066f30 0x7f28b40693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28d4156bb0 0x7f28d4157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28c0003a60 0x7f28d415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 --2- 172.21.15.37:0/1685206704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d40b43b0 0x7f28d40c68a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 >> 172.21.15.37:0/1685206704 conn(0x7f28d406ed90 msgr2=0x7f28d40c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 shutdown_connections 2023-10-06T04:17:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:13.979+0000 7f28d90fa700 1 -- 172.21.15.37:0/1685206704 wait complete. 2023-10-06T04:17:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:14.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:16:56.046938+0000', 'modified': '2023-10-06T04:16:59.691089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/4051514418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 4051514418}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 4051514418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:17:14.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:17:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:17:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.521+0000 7f02628e6700 1 Processor -- start 2023-10-06T04:17:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.521+0000 7f02628e6700 1 -- start start 2023-10-06T04:17:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f02628e6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c15dc70 0x7f025c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f02628e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f02628e6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0ae9f0 con 0x7f025c0b5e30 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f02628e6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0adb70 con 0x7f025c15dc70 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f02628e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0adde0 con 0x7f025c0b6200 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f025b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c15dc70 0x7f025c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f025bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f025c0b5e30 0x7f025c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58572/0 (socket says 172.21.15.37:58572) 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f025bfff700 1 -- 172.21.15.37:0/2919492223 learned_addr learned my addr 172.21.15.37:0/2919492223 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.522+0000 7f025b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c15dc70 0x7f025c0ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40226/0 (socket says 172.21.15.37:40226) 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f0260e83700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025b7fe700 1 -- 172.21.15.37:0/2919492223 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 msgr2=0x7f025c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025b7fe700 1 -- 172.21.15.37:0/2919492223 >> v1:172.21.15.37:6789/0 conn(0x7f025c0b5e30 legacy=0x7f025c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025b7fe700 1 -- 172.21.15.37:0/2919492223 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0ae0c0 con 0x7f025c15dc70 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025affd700 1 -- 172.21.15.37:0/2919492223 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397223217 0 0) 0x7f025c0ae9f0 con 0x7f025c0b5e30 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f0260e83700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0ad0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02500098e0 tx=0x7f02500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fb5cb2131b289 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025affd700 1 -- 172.21.15.37:0/2919492223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250009e80 con 0x7f025c15dc70 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025affd700 1 -- 172.21.15.37:0/2919492223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000b860 con 0x7f025c15dc70 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f025affd700 1 -- 172.21.15.37:0/2919492223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000bbe0 con 0x7f025c15dc70 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f02628e6700 1 -- 172.21.15.37:0/2919492223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 msgr2=0x7f025c0ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.523+0000 7f02628e6700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0ad0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02500098e0 tx=0x7f02500091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 -- 172.21.15.37:0/2919492223 shutdown_connections 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 --2- 172.21.15.37:0/2919492223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0ad0f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 -- 172.21.15.37:0/2919492223 >> 172.21.15.37:0/2919492223 conn(0x7f025c099a10 msgr2=0x7f025c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 -- 172.21.15.37:0/2919492223 shutdown_connections 2023-10-06T04:17:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.524+0000 7f02628e6700 1 -- 172.21.15.37:0/2919492223 wait complete. 2023-10-06T04:17:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.525+0000 7f02628e6700 1 Processor -- start 2023-10-06T04:17:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.525+0000 7f02628e6700 1 -- start start 2023-10-06T04:17:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b5e30 0x7f025c16add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c16a120 con 0x7f025c15dc70 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c14fbf0 con 0x7f025c0b5e30 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c16a940 con 0x7f025c0b6200 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40232/0 (socket says 172.21.15.37:40232) 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 -- 172.21.15.37:0/1793753075 learned_addr learned my addr 172.21.15.37:0/1793753075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f025b7fe700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f025bfff700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b5e30 0x7f025c16add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 -- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 msgr2=0x7f025c140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 -- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b5e30 msgr2=0x7f025c16add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b5e30 0x7f025c16add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 -- 172.21.15.37:0/1793753075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009420 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0260e83700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f025400a380 tx=0x7f02540078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0243fff700 1 -- 172.21.15.37:0/1793753075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254015440 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0243fff700 1 -- 172.21.15.37:0/1793753075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02540155c0 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c16a330 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.526+0000 7f0243fff700 1 -- 172.21.15.37:0/1793753075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254015980 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.527+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c16a650 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.528+0000 7f0243fff700 1 -- 172.21.15.37:0/1793753075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0254003020 con 0x7f025c15dc70 2023-10-06T04:17:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.528+0000 7f0243fff700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.529+0000 7f0243fff700 1 -- 172.21.15.37:0/1793753075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0254084d50 con 0x7f025c15dc70 2023-10-06T04:17:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.529+0000 7f025bfff700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.529+0000 7f025bfff700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f024c007fd0 tx=0x7f024c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.530+0000 7f026bbdeb80 1 Processor -- start 2023-10-06T04:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.530+0000 7f026bbdeb80 1 -- start start 2023-10-06T04:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 0x558baef4bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4ccc0 0x558baef9b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baeea2a70 con 0x558baef9bc00 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baeea0270 con 0x558baef4b840 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baee9c060 con 0x558baef4ccc0 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40242/0 (socket says 172.21.15.37:40242) 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f0260e83700 1 -- 172.21.15.37:0/2042176190 learned_addr learned my addr 172.21.15.37:0/2042176190 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f025bfff700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 0x558baef4bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.531+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4ccc0 0x558baef9b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 -- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4ccc0 msgr2=0x558baef9b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4ccc0 0x558baef9b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 -- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 msgr2=0x558baef4bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 0x558baef4bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 -- 172.21.15.37:0/2042176190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558baed36270 con 0x558baef9bc00 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f025bfff700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 0x558baef4bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f0260e83700 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0254083140 tx=0x7f0254083070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5a53bb40f594d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f02417fa700 1 -- 172.21.15.37:0/2042176190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254056220 con 0x558baef9bc00 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f02417fa700 1 -- 172.21.15.37:0/2042176190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025406d020 con 0x558baef9bc00 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.532+0000 7f02417fa700 1 -- 172.21.15.37:0/2042176190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254055b20 con 0x558baef9bc00 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- 172.21.15.37:0/2042176190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 msgr2=0x558baef9c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0254083140 tx=0x7f0254083070 comp rx=0 tx=0).stop 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- 172.21.15.37:0/2042176190 shutdown_connections 2023-10-06T04:17:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef9c050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4b840 0x558baef4bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/2042176190 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4ccc0 0x558baef9b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- 172.21.15.37:0/2042176190 >> 172.21.15.37:0/2042176190 conn(0x558baef4d160 msgr2=0x558baef4d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- 172.21.15.37:0/2042176190 shutdown_connections 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- 172.21.15.37:0/2042176190 wait complete. 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 -- start start 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.533+0000 7f026bbdeb80 1 Processor -- start 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baef932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baee47890 con 0x558baef9bc00 2023-10-06T04:17:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baee62ea0 con 0x558baef4ccc0 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baed1ee30 con 0x558baef4b840 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f026bbdeb80 10 client.0 _ll_register_callbacks cb 0x558baef0ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40246/0 (socket says 172.21.15.37:40246) 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 -- 172.21.15.37:0/3677172438 learned_addr learned my addr 172.21.15.37:0/3677172438 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f025b7fe700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baef932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f025bfff700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 -- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 msgr2=0x558baef8f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef8f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 -- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 msgr2=0x558baef932b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baef932b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.534+0000 7f0260e83700 1 -- 172.21.15.37:0/3677172438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c001390 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f025bfff700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef8f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f0260e83700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f025400a970 tx=0x7f0254069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c597820fa7bada server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025405cac0 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f025406e030 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558baef40940 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0254055b20 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 10 client.4656 fetch_fsmap learned FSMap version 8 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f025c16a650 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558baef40940 con 0x558baef9bc00 2023-10-06T04:17:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0254065020 con 0x558baef9bc00 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 10 client.4656 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 20 client.4656 populate_metadata read hostname 'smithi037' 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef928e0 0x558baef89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 4 client.4656 mds_command: new command op to 4306 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 --> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558baef1d870 con 0x558baef928e0 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.535+0000 7f025bfff700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef928e0 0x558baef89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.536+0000 7f023a7fc700 10 client.4656 ms_handle_connect on v2:172.21.15.83:6835/4051514418 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.536+0000 7f025bfff700 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef928e0 0x558baef89f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb22f543fb9f7ecd server_cookie=1e1dfb998c6ae910 in_seq=0 out_seq=0 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.536+0000 7f023a7fc700 1 -- 172.21.15.37:0/3677172438 <== mds.0 v2:172.21.15.83:6835/4051514418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558baef1d870 con 0x558baef928e0 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.536+0000 7f023a7fc700 10 client.4656 handle_command_reply: tid=0 2023-10-06T04:17:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 client.4656 shutdown 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 msgr2=0x558baef89a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f025400a970 tx=0x7f0254069000 comp rx=0 tx=0).stop 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 shutdown_connections 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef928e0 0x558baef89f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baef89a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f023a7fc700 0 client.4656 ms_handle_reset on v2:172.21.15.83:6835/4051514418 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef8f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3677172438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baef932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 >> 172.21.15.37:0/3677172438 conn(0x558baef4d160 msgr2=0x558baef74a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 shutdown_connections 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3677172438 wait complete. 2023-10-06T04:17:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.537+0000 7f026bbdeb80 20 client.4656 trim_cache size 0 max 16384 2023-10-06T04:17:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.554+0000 7f026bbdeb80 1 Processor -- start 2023-10-06T04:17:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.554+0000 7f026bbdeb80 1 -- start start 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef95360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 0x558baef47770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baef13e30 con 0x558baef4ccc0 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baef241e0 con 0x558baef9bc00 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baef49d60 con 0x558baef4b840 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40262/0 (socket says 172.21.15.37:40262) 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 -- 172.21.15.37:0/3205008940 learned_addr learned my addr 172.21.15.37:0/3205008940 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 -- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 msgr2=0x558baef95360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef95360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 -- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 msgr2=0x558baef47770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f0260e83700 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 0x558baef47770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 0x558baef47770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 -- 172.21.15.37:0/3205008940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558baecd8fe0 con 0x558baef4ccc0 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f0260e83700 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 0x558baef47770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f025b7fe700 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f025c088cb0 tx=0x7f0250017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b585e5ebfd65293 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f0241ffb700 1 -- 172.21.15.37:0/3205008940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250021040 con 0x558baef4ccc0 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f0241ffb700 1 -- 172.21.15.37:0/3205008940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250022040 con 0x558baef4ccc0 2023-10-06T04:17:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.555+0000 7f0241ffb700 1 -- 172.21.15.37:0/3205008940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250028440 con 0x558baef4ccc0 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3205008940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 msgr2=0x558baef4d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f025c088cb0 tx=0x7f0250017000 comp rx=0 tx=0).stop 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3205008940 shutdown_connections 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef9bc00 0x558baef47770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef95360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3205008940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef4ccc0 0x558baef4d700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3205008940 >> 172.21.15.37:0/3205008940 conn(0x558baef4d160 msgr2=0x558baef91e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3205008940 shutdown_connections 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3205008940 wait complete. 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.556+0000 7f026bbdeb80 1 -- start start 2023-10-06T04:17:14.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 Processor -- start 2023-10-06T04:17:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baeff6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baefb3630 con 0x558baef9bc00 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558baefb3b20 con 0x558baef4ccc0 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x558baefb1cd0 con 0x558baef4b840 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f026bbdeb80 10 client.0 _ll_register_callbacks cb 0x558baef0ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f0260e83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40278/0 (socket says 172.21.15.37:40278) 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f0260e83700 1 -- 172.21.15.37:0/3177944994 learned_addr learned my addr 172.21.15.37:0/3177944994 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.557+0000 7f025b7fe700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baeff6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f025bfff700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 -- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 msgr2=0x558baef483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 -- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 msgr2=0x558baeff6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baeff6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 -- 172.21.15.37:0/3177944994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0ae0c0 con 0x558baef9bc00 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f025bfff700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f0260e83700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0254055390 tx=0x7f025407f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae328484346c9a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254058d70 con 0x558baef9bc00 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f025406e070 con 0x558baef9bc00 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f025406d020 con 0x558baef9bc00 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0254056e10 con 0x558baef9bc00 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 10 client.4662 fetch_fsmap learned FSMap version 8 2023-10-06T04:17:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558baee6a780 con 0x558baef9bc00 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025406d020 con 0x558baef9bc00 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0254055d80 con 0x558baef9bc00 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 20 client.4662 populate_metadata read hostname 'smithi037' 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef8a680 0x558baef8aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 4 client.4662 mds_command: new command op to 4306 tid=0[{"prefix": "status"}] 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.558+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 --> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558baee3ee00 con 0x558baef8a680 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f025bfff700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef8a680 0x558baef8aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f023a7fc700 10 client.4662 ms_handle_connect on v2:172.21.15.83:6835/4051514418 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f025bfff700 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef8a680 0x558baef8aa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb924883136814b3 server_cookie=8ea9482edce14877 in_seq=0 out_seq=0 2023-10-06T04:17:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f023a7fc700 1 -- 172.21.15.37:0/3177944994 <== mds.0 v2:172.21.15.83:6835/4051514418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558baee3ee00 con 0x558baef8a680 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f023a7fc700 10 client.4662 handle_command_reply: tid=0 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 client.4662 shutdown 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 msgr2=0x558baefb0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0254055390 tx=0x7f025407f070 comp rx=0 tx=0).stop 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 shutdown_connections 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:6835/4051514418,v1:172.21.15.83:6837/4051514418] conn(0x558baef8a680 0x558baef8aa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558baef9bc00 0x558baefb0f40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x558baef4b840 0x558baef483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f023a7fc700 0 client.4662 ms_handle_reset on v2:172.21.15.83:6835/4051514418 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 --2- 172.21.15.37:0/3177944994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558baef4ccc0 0x558baeff6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 >> 172.21.15.37:0/3177944994 conn(0x558baef4d160 msgr2=0x558baef9b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 shutdown_connections 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.559+0000 7f026bbdeb80 1 -- 172.21.15.37:0/3177944994 wait complete. 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f026bbdeb80 20 client.4662 trim_cache size 0 max 16384 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "40813f02-7e3b-4d33-ae21-8c35b4fd9578", 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4306, 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:17:14.570 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 17.877626241000002, 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 23, 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 23, 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 23.843884104000001 2023-10-06T04:17:14.571 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 msgr2=0x7f02480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f024c007fd0 tx=0x7f024c007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 msgr2=0x7f025c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f025400a380 tx=0x7f02540078f0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 shutdown_connections 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c15dc70 0x7f025c0b47b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b5e30 0x7f025c16add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 --2- 172.21.15.37:0/1793753075 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0b6200 0x7f025c140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:14.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 >> 172.21.15.37:0/1793753075 conn(0x7f025c099a10 msgr2=0x7f025c151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:14.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 shutdown_connections 2023-10-06T04:17:14.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:14.560+0000 7f02628e6700 1 -- 172.21.15.37:0/1793753075 wait complete. 2023-10-06T04:17:14.574 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:17:14.595 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:17:14.595 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:17:14.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.595 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:17:14.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:17:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-10-06T04:17:14.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:17:14.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.681 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:17:14.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:17:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-10-06T04:17:14.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:17:14.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.804 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:17:14.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.824 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:17:14.896 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T04:17:14.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:17:14.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.898 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:17:14.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:14.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:17:15.023 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T04:17:15.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:17:15.025 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T04:17:15.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:17:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.142+0000 7f8e86527700 1 Processor -- start 2023-10-06T04:17:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.142+0000 7f8e86527700 1 -- start start 2023-10-06T04:17:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e86527700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8e800b2810 0x7f8e800cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e86527700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800cfa20 con 0x7f8e800ce780 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e86527700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800cee10 con 0x7f8e800cd2c0 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e86527700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800cec20 con 0x7f8e800b2810 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e84d24700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8e800ce780 0x7f8e800ccbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58584/0 (socket says 172.21.15.37:58584) 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e84d24700 1 -- 172.21.15.37:0/3480788699 learned_addr learned my addr 172.21.15.37:0/3480788699 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e85525700 1 --2- 172.21.15.37:0/3480788699 >> v2:172.21.15.83:3300/0 conn(0x7f8e800b2810 0x7f8e800cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312913964 0 0) 0x7f8e800cfa20 con 0x7f8e800ce780 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.143+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e68003570 con 0x7f8e800ce780 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659501700 0 0) 0x7f8e68003570 con 0x7f8e800ce780 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 >> v2:172.21.15.83:3300/0 conn(0x7f8e800b2810 msgr2=0x7f8e800cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 --2- 172.21.15.37:0/3480788699 >> v2:172.21.15.83:3300/0 conn(0x7f8e800b2810 0x7f8e800cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 >> v1:172.21.15.83:6789/0 conn(0x7f8e800cd2c0 legacy=0x7f8e800b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800cf0f0 con 0x7f8e800ce780 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f8e74001470 con 0x7f8e800ce780 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 >> v1:172.21.15.37:6789/0 conn(0x7f8e800ce780 legacy=0x7f8e800ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e68003a60 0x7f8e68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 0x7f8e68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e680051c0 0x7f8e6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6800c0a0 con 0x7f8e680051c0 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6800c210 con 0x7f8e68004810 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6800c3d0 con 0x7f8e68003a60 2023-10-06T04:17:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 0x7f8e68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e85d26700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e680051c0 0x7f8e6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e85525700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e68003a60 0x7f8e68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 -- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e68003a60 msgr2=0x7f8e68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e68003a60 0x7f8e68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 -- 172.21.15.37:0/3480788699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e680051c0 msgr2=0x7f8e6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e680051c0 0x7f8e6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 -- 172.21.15.37:0/3480788699 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68003570 con 0x7f8e68004810 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e85d26700 1 -- 172.21.15.37:0/3480788699 reap_dead start 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e84d24700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 0x7f8e68004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c3c0 tx=0x7f8e74001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f922470f8e494aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400cc90 con 0x7f8e68004810 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400cdf0 con 0x7f8e68004810 2023-10-06T04:17:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.144+0000 7f8e7ffff700 1 -- 172.21.15.37:0/3480788699 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74005b70 con 0x7f8e68004810 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 -- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 msgr2=0x7f8e68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 0x7f8e68004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c3c0 tx=0x7f8e74001e50 comp rx=0 tx=0).stop 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 -- 172.21.15.37:0/3480788699 shutdown_connections 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 --2- 172.21.15.37:0/3480788699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e68004810 0x7f8e68004c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 -- 172.21.15.37:0/3480788699 >> 172.21.15.37:0/3480788699 conn(0x7f8e8006ed90 msgr2=0x7f8e8006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 -- 172.21.15.37:0/3480788699 shutdown_connections 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.145+0000 7f8e86527700 1 -- 172.21.15.37:0/3480788699 wait complete. 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.146+0000 7f8e86527700 1 Processor -- start 2023-10-06T04:17:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.146+0000 7f8e86527700 1 -- start start 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e800c5230 0x7f8e800c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8015bbc0 0x7f8e8015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800c5be0 con 0x7f8e68004810 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8015c8f0 con 0x7f8e8015bbc0 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e86527700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801586e0 con 0x7f8e800c5230 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40294/0 (socket says 172.21.15.37:40294) 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 -- 172.21.15.37:0/716103485 learned_addr learned my addr 172.21.15.37:0/716103485 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e84d24700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e800c5230 0x7f8e800c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85d26700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8015bbc0 0x7f8e8015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 -- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e800c5230 msgr2=0x7f8e800c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e800c5230 0x7f8e800c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 -- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8015bbc0 msgr2=0x7f8e8015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8015bbc0 0x7f8e8015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.147+0000 7f8e85525700 1 -- 172.21.15.37:0/716103485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e801589c0 con 0x7f8e68004810 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e85525700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e78011f80 tx=0x7f8e7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7800e040 con 0x7f8e68004810 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7800f040 con 0x7f8e68004810 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80158ca0 con 0x7f8e68004810 2023-10-06T04:17:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78015430 con 0x7f8e68004810 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.148+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e80155ec0 con 0x7f8e68004810 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.149+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e80159140 con 0x7f8e68004810 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.149+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e78015820 con 0x7f8e68004810 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.149+0000 7f8e7d7fa700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 0x7f8e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.149+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e780852e0 con 0x7f8e68004810 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.150+0000 7f8e84d24700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 0x7f8e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.150+0000 7f8e84d24700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 0x7f8e6c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e74001e90 tx=0x7f8e74015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.154+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e780523f0 con 0x7f8e68004810 2023-10-06T04:17:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.394+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8e8004c3c0 con 0x7f8e68004810 2023-10-06T04:17:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.394+0000 7f8e7d7fa700 1 -- 172.21.15.37:0/716103485 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8e78055a10 con 0x7f8e68004810 2023-10-06T04:17:15.397 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:17:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 msgr2=0x7f8e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 0x7f8e6c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e74001e90 tx=0x7f8e74015000 comp rx=0 tx=0).stop 2023-10-06T04:17:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 msgr2=0x7f8e80155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e78011f80 tx=0x7f8e7800b040 comp rx=0 tx=0).stop 2023-10-06T04:17:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 shutdown_connections 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8e6c066f30 0x7f8e6c0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8015bbc0 0x7f8e8015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e68004810 0x7f8e80155980 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 --2- 172.21.15.37:0/716103485 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e800c5230 0x7f8e800c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 >> 172.21.15.37:0/716103485 conn(0x7f8e8006ed90 msgr2=0x7f8e800c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 shutdown_connections 2023-10-06T04:17:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:15.396+0000 7f8e86527700 1 -- 172.21.15.37:0/716103485 wait complete. 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:17:15.411 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:17:15.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.412 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:17:15.427 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:15.427 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:15.428 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:17:15.429 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42420sec preferred_lft 42420sec 2023-10-06T04:17:15.430 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:17:15.430 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:15.430 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:15.430 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:15.430 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T04:17:15.431 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:17:15.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.431 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:15.431 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:15.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:17:15.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-10-06T04:17:15.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-10-06T04:17:15.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:17:15.432 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:15.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.599 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:17:15.642 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:17:15.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.644 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:17:15.713 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:17:15.713 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:17:15.713 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:17:15.714 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:17:15.714 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:17:15.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.714 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:15.715 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:15.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:17:15.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:17:15.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:17:15.715 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:15.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:15.993 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:17:16.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:16.009 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T04:17:16.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:16.063 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:16.063 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:16.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:17:16.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:17:16.064 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:16.154 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:17:16.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:16.154 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:16.154 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:17:16.155 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:16.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:16.342 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:16.342 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:16.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:17:16.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:17:16.342 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:16.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:16.442 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:17:16.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:16.459 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:16.518 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:17:16.518 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:17:16.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:16.618 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:16.619 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:16.619 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:16.686 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:16.687 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:16.687 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:16.687 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:16.687 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T04:17:16.709 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=40813f02-7e3b-4d33-ae21-8c35b4fd9578" will pass to kernel 2023-10-06T04:17:16.711 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:17:16.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:16.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:16.738 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T04:17:16.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:17:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.896+0000 7f894f9a3700 1 Processor -- start 2023-10-06T04:17:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.896+0000 7f894f9a3700 1 -- start start 2023-10-06T04:17:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 0x7f8948067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8948068320 0x7f89481571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f8948157730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8948157c70 con 0x7f8948068320 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894815c010 con 0x7f89480b26d0 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894f9a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894815b400 con 0x7f89480b2aa0 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894cf3e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8948068320 0x7f89481571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894cf3e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8948068320 0x7f89481571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55468/0 (socket says 172.21.15.37:55468) 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.897+0000 7f894cf3e700 1 -- 172.21.15.37:0/983352182 learned_addr learned my addr 172.21.15.37:0/983352182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894df40700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f8948157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894d73f700 1 --2- 172.21.15.37:0/983352182 >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 0x7f8948067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 -- 172.21.15.37:0/983352182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 msgr2=0x7f8948157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f8948157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 -- 172.21.15.37:0/983352182 >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 msgr2=0x7f8948067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:16.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 --2- 172.21.15.37:0/983352182 >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 0x7f8948067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 -- 172.21.15.37:0/983352182 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894815b6e0 con 0x7f8948068320 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894d73f700 1 --2- 172.21.15.37:0/983352182 >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 0x7f8948067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894cf3e700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f89481571f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89480afe80 tx=0x7f893c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946ccf7e95d86a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f8947fff700 1 -- 172.21.15.37:0/983352182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00b860 con 0x7f8948068320 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f8947fff700 1 -- 172.21.15.37:0/983352182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00b9c0 con 0x7f8948068320 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f8947fff700 1 -- 172.21.15.37:0/983352182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00bd60 con 0x7f8948068320 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894f9a3700 1 -- 172.21.15.37:0/983352182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 msgr2=0x7f89481571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.898+0000 7f894f9a3700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f89481571f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89480afe80 tx=0x7f893c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 -- 172.21.15.37:0/983352182 shutdown_connections 2023-10-06T04:17:16.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f8948157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 --2- 172.21.15.37:0/983352182 >> v2:172.21.15.83:3300/0 conn(0x7f89480b26d0 0x7f8948067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 --2- 172.21.15.37:0/983352182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f89481571f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 -- 172.21.15.37:0/983352182 >> 172.21.15.37:0/983352182 conn(0x7f8948068770 msgr2=0x7f8948068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 -- 172.21.15.37:0/983352182 shutdown_connections 2023-10-06T04:17:16.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.899+0000 7f894f9a3700 1 -- 172.21.15.37:0/983352182 wait complete. 2023-10-06T04:17:16.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.900+0000 7f894f9a3700 1 Processor -- start 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.900+0000 7f894f9a3700 1 -- start start 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89480b26d0 0x7f894813bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f894814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948168f40 con 0x7f8948068320 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894814b690 con 0x7f89480b26d0 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894814d5a0 con 0x7f89480b2aa0 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55476/0 (socket says 172.21.15.37:55476) 2023-10-06T04:17:16.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 -- 172.21.15.37:0/1315255356 learned_addr learned my addr 172.21.15.37:0/1315255356 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894cf3e700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89480b26d0 0x7f894813bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894df40700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f894814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 -- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 msgr2=0x7f894814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f894814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 -- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89480b26d0 msgr2=0x7f894813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89480b26d0 0x7f894813bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 -- 172.21.15.37:0/1315255356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0094f0 con 0x7f8948068320 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894df40700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f894814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894d73f700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f894000a430 tx=0x7f8940007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000d650 con 0x7f8948068320 2023-10-06T04:17:16.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894000d7b0 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894814c990 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.901+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894000db50 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.902+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894814cf50 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.902+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894814d880 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.903+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8940015440 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.903+0000 7f89457fa700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 0x7f89340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.903+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8940084f50 con 0x7f8948068320 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.903+0000 7f894cf3e700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 0x7f89340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:16.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.904+0000 7f894cf3e700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 0x7f89340693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89480afe80 tx=0x7f893c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:16.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:16.908+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f894004e5a0 con 0x7f8948068320 2023-10-06T04:17:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.144+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8948063410 con 0x7f8948068320 2023-10-06T04:17:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.144+0000 7f89457fa700 1 -- 172.21.15.37:0/1315255356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f894001a070 con 0x7f8948068320 2023-10-06T04:17:17.147 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:17:17.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 msgr2=0x7f89340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 0x7f89340693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89480afe80 tx=0x7f893c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 msgr2=0x7f8948168a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f894000a430 tx=0x7f8940007910 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 shutdown_connections 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89480b2aa0 0x7f894814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8948068320 0x7f8948168a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8934066f30 0x7f89340693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 --2- 172.21.15.37:0/1315255356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89480b26d0 0x7f894813bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 >> 172.21.15.37:0/1315255356 conn(0x7f8948068770 msgr2=0x7f89480cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 shutdown_connections 2023-10-06T04:17:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:17.146+0000 7f894f9a3700 1 -- 172.21.15.37:0/1315255356 wait complete. 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:17:17.160 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:17:17.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:17:17.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:17:17.161 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:17:17.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.161 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:17:17.176 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:17.176 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:17.176 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:17.176 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:17.177 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:75:ee:67:65:08 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:17:17.178 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::10fa:95ff:fe1a:759b/64 scope link tentative 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:75:ee:67:65:08 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::3475:eeff:fe67:6508/64 scope link tentative 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.180 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:17:17.240 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:17:17.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.241 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:17:17.297 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:17:17.298 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:17:17.298 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:17:17.298 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:17:17.298 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:17:17.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.298 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:17.298 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:17.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:17:17.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:17:17.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:17:17.299 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:17.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.401 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:17:17.415 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:17:17.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.416 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T04:17:17.470 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:17:17.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.471 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:17.471 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:17.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:17:17.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:17:17.471 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:17.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:17:17.597 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:17.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:17.597 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:17.597 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.597 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 8e:2d:f6:be:8f:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::8c2d:f6ff:febe:8fb0/64 scope link tentative 2023-10-06T04:17:17.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:17:17.688 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:17.688 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:17.688 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:17.688 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.688 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 8e:2d:f6:be:8f:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::8c2d:f6ff:febe:8fb0/64 scope link tentative 2023-10-06T04:17:17.689 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:17.697 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:17:17.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:17:17.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:17:17.698 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:17.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-10-06T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:17:17.908 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:17.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:17.990 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:17:18.005 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:17:18.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:18.005 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:17:18.060 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:17:18.060 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:17:18.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:17:18.142 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:17:18.142 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:17:18.142 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:18.151 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:17:18.151 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:17:18.151 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:18.151 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:18.151 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:18.173 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:17:18.173 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T04:17:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=40813f02-7e3b-4d33-ae21-8c35b4fd9578" will pass to kernel 2023-10-06T04:17:18.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:17:18.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:17:18.241 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T04:17:18.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:17:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.398+0000 7f26f579d700 1 Processor -- start 2023-10-06T04:17:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.398+0000 7f26f579d700 1 -- start start 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f579d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00b2810 0x7f26f00cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f579d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f26f00cd2c0 0x7f26f015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f579d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00cfa20 con 0x7f26f00ce780 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f579d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f0159b40 con 0x7f26f00cd2c0 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f579d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00cebf0 con 0x7f26f00b2810 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f26f00cd2c0 0x7f26f015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26effff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00b2810 0x7f26f00cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26ef7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f26f00ce780 0x7f26f00ccbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:34066/0 (socket says 172.21.15.37:34066) 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f26f00cd2c0 0x7f26f015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:47030/0 (socket says 172.21.15.37:47030) 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26ef7fe700 1 -- 172.21.15.37:0/1408567832 learned_addr learned my addr 172.21.15.37:0/1408567832 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 -- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00b2810 msgr2=0x7f26f00cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 --2- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00b2810 0x7f26f00cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 -- 172.21.15.37:0/1408567832 >> v1:172.21.15.83:6789/0 conn(0x7f26f00ce780 legacy=0x7f26f00ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.399+0000 7f26f4f9c700 1 -- 172.21.15.37:0/1408567832 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f015e140 con 0x7f26f00cd2c0 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f4f9c700 1 --2- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00cd2c0 0x7f26f015dc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009e90 tx=0x7f26e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baada42551337004 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26eeffd700 1 -- 172.21.15.37:0/1408567832 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e800e070 con 0x7f26f00cd2c0 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26eeffd700 1 -- 172.21.15.37:0/1408567832 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e800bbf0 con 0x7f26f00cd2c0 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26eeffd700 1 -- 172.21.15.37:0/1408567832 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8012430 con 0x7f26f00cd2c0 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 -- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00cd2c0 msgr2=0x7f26f015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 --2- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00cd2c0 0x7f26f015dc00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009e90 tx=0x7f26e8009780 comp rx=0 tx=0).stop 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 -- 172.21.15.37:0/1408567832 shutdown_connections 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 --2- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00cd2c0 0x7f26f015dc00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 --2- 172.21.15.37:0/1408567832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00b2810 0x7f26f00cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 -- 172.21.15.37:0/1408567832 >> 172.21.15.37:0/1408567832 conn(0x7f26f006ed90 msgr2=0x7f26f006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 -- 172.21.15.37:0/1408567832 shutdown_connections 2023-10-06T04:17:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.400+0000 7f26f579d700 1 -- 172.21.15.37:0/1408567832 wait complete. 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.401+0000 7f26f579d700 1 Processor -- start 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 -- start start 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00cd2c0 0x7f26f016bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 0x7f26f00b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0157aa0 con 0x7f26f00b2810 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f016a940 con 0x7f26f00ce780 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f579d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00b6020 con 0x7f26f00cd2c0 2023-10-06T04:17:18.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26effff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26effff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55492/0 (socket says 172.21.15.37:55492) 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26effff700 1 -- 172.21.15.37:0/1667121869 learned_addr learned my addr 172.21.15.37:0/1667121869 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26f4f9c700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 0x7f26f00b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.402+0000 7f26ef7fe700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00cd2c0 0x7f26f016bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 -- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00cd2c0 msgr2=0x7f26f016bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00cd2c0 0x7f26f016bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 -- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 msgr2=0x7f26f00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 0x7f26f00b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 -- 172.21.15.37:0/1667121869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e8009a20 con 0x7f26f00b2810 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26f4f9c700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 0x7f26f00b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26effff700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26e000ec80 tx=0x7f26e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000c850 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000c9b0 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0157170 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000cd50 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.403+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f0157730 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.404+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f0157d80 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.404+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26e0013680 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.405+0000 7f26d7fff700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 0x7f26dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.405+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f26e0084930 con 0x7f26f00b2810 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.405+0000 7f26ef7fe700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 0x7f26dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:18.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.406+0000 7f26ef7fe700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 0x7f26dc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26f00afa70 tx=0x7f26e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:18.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.409+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26e0051a40 con 0x7f26f00b2810 2023-10-06T04:17:18.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.650+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26f0155bf0 con 0x7f26f00b2810 2023-10-06T04:17:18.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.650+0000 7f26d7fff700 1 -- 172.21.15.37:0/1667121869 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f26f0155bf0 con 0x7f26f00b2810 2023-10-06T04:17:18.652 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 msgr2=0x7f26dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 0x7f26dc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26f00afa70 tx=0x7f26e4009040 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 msgr2=0x7f26f016a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26e000ec80 tx=0x7f26e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 shutdown_connections 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f26dc066f30 0x7f26dc0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f26f00ce780 0x7f26f00b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26f00b2810 0x7f26f016a400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 --2- 172.21.15.37:0/1667121869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f26f00cd2c0 0x7f26f016bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 >> 172.21.15.37:0/1667121869 conn(0x7f26f006ed90 msgr2=0x7f26f00cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 shutdown_connections 2023-10-06T04:17:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:18.652+0000 7f26f579d700 1 -- 172.21.15.37:0/1667121869 wait complete. 2023-10-06T04:17:18.666 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:17:18.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:17:18.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:17:18.667 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:17:18.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.667 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T04:17:18.685 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T04:17:18.686 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T04:17:18.687 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:18.688 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:17:18.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:17:18.688 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:18.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.859 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:17:18.901 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:17:18.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.902 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T04:17:18.971 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T04:17:18.971 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:17:18.971 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:17:18.971 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:17:18.972 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:17:18.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:17:18.972 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:19.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.240 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:17:19.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.255 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T04:17:19.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.309 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:19.310 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:19.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:17:19.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:17:19.310 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:19.399 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:17:19.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.400 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:19.400 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:19.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:17:19.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:17:19.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:17:19.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:17:19.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:17:19.401 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:19.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.601 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:19.601 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:19.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-10-06T04:17:19.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:17:19.601 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:19.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:19.695 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:17:19.709 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:17:19.710 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:19.710 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:17:19.764 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:17:19.765 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:17:19.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:17:19.848 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:17:19.849 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:17:19.849 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:19.921 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:17:19.921 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:17:19.921 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:19.921 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:19.921 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T04:17:19.942 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=40813f02-7e3b-4d33-ae21-8c35b4fd9578" will pass to kernel 2023-10-06T04:17:19.944 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:17:19.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:19.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:17:20.009 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T04:17:20.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:17:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.140+0000 7f6550db8700 1 Processor -- start 2023-10-06T04:17:20.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.140+0000 7f6550db8700 1 -- start start 2023-10-06T04:17:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f6550db8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cbf50 0x7f654c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f6550db8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0ccf60 0x7f654c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f6550db8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0b10c0 con 0x7f654c0cc320 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f6550db8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0ca750 con 0x7f654c0cbf50 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f6550db8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0cd8a0 con 0x7f654c0ccf60 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f654a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cbf50 0x7f654c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f654a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cbf50 0x7f654c0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55502/0 (socket says 172.21.15.37:55502) 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f654a59c700 1 -- 172.21.15.37:0/3988015683 learned_addr learned my addr 172.21.15.37:0/3988015683 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.141+0000 7f654ad9d700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0ccf60 0x7f654c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654a59c700 1 -- 172.21.15.37:0/3988015683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0ccf60 msgr2=0x7f654c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654a59c700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0ccf60 0x7f654c0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654a59c700 1 -- 172.21.15.37:0/3988015683 >> v1:172.21.15.83:6789/0 conn(0x7f654c0cc320 legacy=0x7f654c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654959a700 1 -- 172.21.15.37:0/3988015683 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151793985 0 0) 0x7f654c0b10c0 con 0x7f654c0cc320 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654a59c700 1 -- 172.21.15.37:0/3988015683 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0b04b0 con 0x7f654c0cbf50 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654a59c700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0ca210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f654400d1a0 tx=0x7f654400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ddad0ba1a23616 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654959a700 1 -- 172.21.15.37:0/3988015683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544010070 con 0x7f654c0cbf50 2023-10-06T04:17:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654959a700 1 -- 172.21.15.37:0/3988015683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400de10 con 0x7f654c0cbf50 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.142+0000 7f654959a700 1 -- 172.21.15.37:0/3988015683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400b320 con 0x7f654c0cbf50 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 -- 172.21.15.37:0/3988015683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 msgr2=0x7f654c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0ca210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f654400d1a0 tx=0x7f654400ba50 comp rx=0 tx=0).stop 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 -- 172.21.15.37:0/3988015683 shutdown_connections 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0ccf60 0x7f654c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 --2- 172.21.15.37:0/3988015683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0ca210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 -- 172.21.15.37:0/3988015683 >> 172.21.15.37:0/3988015683 conn(0x7f654c06a810 msgr2=0x7f654c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 -- 172.21.15.37:0/3988015683 shutdown_connections 2023-10-06T04:17:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.143+0000 7f6550db8700 1 -- 172.21.15.37:0/3988015683 wait complete. 2023-10-06T04:17:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.144+0000 7f6550db8700 1 Processor -- start 2023-10-06T04:17:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.144+0000 7f6550db8700 1 -- start start 2023-10-06T04:17:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 0x7f654c0a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ccf60 0x7f654c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0a8ab0 con 0x7f654c0cbf50 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0a7300 con 0x7f654c0ccf60 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6550db8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c154740 con 0x7f654c0cc320 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55508/0 (socket says 172.21.15.37:55508) 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 -- 172.21.15.37:0/2270419011 learned_addr learned my addr 172.21.15.37:0/2270419011 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654ad9d700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ccf60 0x7f654c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6549d9b700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 0x7f654c0a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 -- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 msgr2=0x7f654c0a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 0x7f654c0a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 -- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ccf60 msgr2=0x7f654c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ccf60 0x7f654c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 -- 172.21.15.37:0/2270419011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654400bcf0 con 0x7f654c0cbf50 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f6549d9b700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 0x7f654c0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f654a59c700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f654c06e460 tx=0x7f654401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.145+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400ab40 con 0x7f654c0cbf50 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.146+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654400ace0 con 0x7f654c0cbf50 2023-10-06T04:17:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.146+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c0a66f0 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.146+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440286b0 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.146+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c0a6cb0 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.146+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c063410 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.147+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6544003040 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.147+0000 7f65427fc700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.148+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6544088720 con 0x7f654c0cbf50 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.148+0000 7f6549d9b700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.148+0000 7f6549d9b700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f654c0a7c90 tx=0x7f6534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.152+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6544055830 con 0x7f654c0cbf50 2023-10-06T04:17:20.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.393+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f654c0b0790 con 0x7f654c0cbf50 2023-10-06T04:17:20.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.393+0000 7f65427fc700 1 -- 172.21.15.37:0/2270419011 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6544058e50 con 0x7f654c0cbf50 2023-10-06T04:17:20.396 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:17:20.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 msgr2=0x7f652c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f654c0a7c90 tx=0x7f6534009040 comp rx=0 tx=0).stop 2023-10-06T04:17:20.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 msgr2=0x7f654c0a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f654c06e460 tx=0x7f654401a000 comp rx=0 tx=0).stop 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 shutdown_connections 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.395+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ccf60 0x7f654c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.396+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cbf50 0x7f654c0a6010 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.396+0000 7f6550db8700 1 --2- 172.21.15.37:0/2270419011 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c0cc320 0x7f654c0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.396+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 >> 172.21.15.37:0/2270419011 conn(0x7f654c06a810 msgr2=0x7f654c156070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.396+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 shutdown_connections 2023-10-06T04:17:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:20.396+0000 7f6550db8700 1 -- 172.21.15.37:0/2270419011 wait complete. 2023-10-06T04:17:20.410 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:17:20.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:17:20.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-10-06T04:17:20.410 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:17:20.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:17:20.411 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:17:20.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:17:20.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:17:20.411 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:17:20.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.411 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:20.427 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:20.428 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2023-10-06T04:17:20.428 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:20.429 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether b6:a6:8c:f1:d5:97 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::a4c4:e2ff:fec8:1cf2/64 scope link tentative 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether b6:a6:8c:f1:d5:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::b4a6:8cff:fef1:d597/64 scope link tentative 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.431 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:17:20.490 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-10-06T04:17:20.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.492 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-10-06T04:17:20.548 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-10-06T04:17:20.548 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:17:20.548 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:17:20.548 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:17:20.548 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:17:20.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:17:20.549 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:20.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.649 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:17:20.664 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:17:20.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.665 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-10-06T04:17:20.719 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:17:20.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.720 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:20.720 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:20.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:17:20.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:17:20.720 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:20.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:17:20.843 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:20.843 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:20.843 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:20.843 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether f2:96:61:03:f2:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::f096:61ff:fe03:f252/64 scope link tentative 2023-10-06T04:17:20.844 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.936 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:17:20.937 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether f2:96:61:03:f2:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:17:20.937 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:17:20.937 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.937 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::f096:61ff:fe03:f252/64 scope link 2023-10-06T04:17:20.937 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:20.949 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:17:20.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:20.949 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:20.949 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:17:20.950 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:21.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:21.172 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-10-06T04:17:21.172 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-10-06T04:17:21.172 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2023-10-06T04:17:21.172 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:17:21.172 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-10-06T04:17:21.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:21.252 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:17:21.267 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:17:21.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:21.267 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:17:21.321 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:17:21.321 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:17:21.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:17:21.400 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:17:21.400 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:17:21.400 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:21.408 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:17:21.408 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:17:21.409 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:21.409 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:21.409 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T04:17:21.430 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T04:17:21.431 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=40813f02-7e3b-4d33-ae21-8c35b4fd9578" will pass to kernel 2023-10-06T04:17:21.432 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:17:21.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:21.432 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:17:21.496 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:17:21.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.645+0000 7f471bd26700 1 Processor -- start 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.646+0000 7f471bd26700 1 -- start start 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.646+0000 7f471bd26700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47140cb400 0x7f47140c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.646+0000 7f471bd26700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714067660 con 0x7f47140c75b0 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.646+0000 7f471bd26700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714067f00 con 0x7f47140cb030 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.646+0000 7f471bd26700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140c7d80 con 0x7f47140cb400 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47140cb400 0x7f47140c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:21.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f471a2c3700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47140c75b0 0x7f47140cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54072/0 (socket says 172.21.15.37:54072) 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47140cb400 0x7f47140c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55514/0 (socket says 172.21.15.37:55514) 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f471a2c3700 1 -- 172.21.15.37:0/2249815012 learned_addr learned my addr 172.21.15.37:0/2249815012 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 -- 172.21.15.37:0/2249815012 >> v1:172.21.15.83:6789/0 conn(0x7f47140cb030 legacy=0x7f47140a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 -- 172.21.15.37:0/2249815012 >> v1:172.21.15.37:6789/0 conn(0x7f47140c75b0 legacy=0x7f47140cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f4718ac0700 1 -- 172.21.15.37:0/2249815012 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928019334 0 0) 0x7f4714067660 con 0x7f47140c75b0 2023-10-06T04:17:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 -- 172.21.15.37:0/2249815012 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140cb8a0 con 0x7f47140cb400 2023-10-06T04:17:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f47192c1700 1 --2- 172.21.15.37:0/2249815012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140cb400 0x7f47140c7070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47080098e0 tx=0x7f47080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e0e431b5ca0d6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f4718ac0700 1 -- 172.21.15.37:0/2249815012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708009e80 con 0x7f47140cb400 2023-10-06T04:17:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f4718ac0700 1 -- 172.21.15.37:0/2249815012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800b860 con 0x7f47140cb400 2023-10-06T04:17:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.647+0000 7f4718ac0700 1 -- 172.21.15.37:0/2249815012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800bbe0 con 0x7f47140cb400 2023-10-06T04:17:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 -- 172.21.15.37:0/2249815012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140cb400 msgr2=0x7f47140c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 --2- 172.21.15.37:0/2249815012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140cb400 0x7f47140c7070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47080098e0 tx=0x7f47080091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 -- 172.21.15.37:0/2249815012 shutdown_connections 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 --2- 172.21.15.37:0/2249815012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140cb400 0x7f47140c7070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 -- 172.21.15.37:0/2249815012 >> 172.21.15.37:0/2249815012 conn(0x7f47140c9540 msgr2=0x7f47140c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 -- 172.21.15.37:0/2249815012 shutdown_connections 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.648+0000 7f471bd26700 1 -- 172.21.15.37:0/2249815012 wait complete. 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.649+0000 7f471bd26700 1 Processor -- start 2023-10-06T04:17:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.649+0000 7f471bd26700 1 -- start start 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47140cb030 0x7f47140aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 0x7f471406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b2110 con 0x7f47140c75b0 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c6220 con 0x7f47140cb030 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471bd26700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b1500 con 0x7f47140cb400 2023-10-06T04:17:21.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55524/0 (socket says 172.21.15.37:55524) 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 -- 172.21.15.37:0/999501870 learned_addr learned my addr 172.21.15.37:0/999501870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f47192c1700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47140cb030 0x7f47140aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471a2c3700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 0x7f471406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 -- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 msgr2=0x7f471406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 0x7f471406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 -- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47140cb030 msgr2=0x7f47140aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47140cb030 0x7f47140aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f4719ac2700 1 -- 172.21.15.37:0/999501870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009420 con 0x7f47140c75b0 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.650+0000 7f471a2c3700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 0x7f471406aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f4719ac2700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c5c0 tx=0x7f470c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c011590 con 0x7f47140c75b0 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c011710 con 0x7f47140c75b0 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140b17e0 con 0x7f47140c75b0 2023-10-06T04:17:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c011ad0 con 0x7f47140c75b0 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.651+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140b1da0 con 0x7f47140c75b0 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.652+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4714063410 con 0x7f47140c75b0 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.652+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f470c01b3b0 con 0x7f47140c75b0 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.653+0000 7f4711ffb700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.653+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f470c083c30 con 0x7f47140c75b0 2023-10-06T04:17:21.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.653+0000 7f47192c1700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:21.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.653+0000 7f47192c1700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 0x7f47000693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47080093f0 tx=0x7f4708017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:21.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.657+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f470c050d40 con 0x7f47140c75b0 2023-10-06T04:17:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.851+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47140acf70 con 0x7f47140c75b0 2023-10-06T04:17:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.852+0000 7f4711ffb700 1 -- 172.21.15.37:0/999501870 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f470c017070 con 0x7f47140c75b0 2023-10-06T04:17:21.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:21.855 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 msgr2=0x7f47000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 0x7f47000693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47080093f0 tx=0x7f4708017000 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 msgr2=0x7f47140c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c5c0 tx=0x7f470c00c980 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 shutdown_connections 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47140cb400 0x7f471406aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47140c75b0 0x7f47140c54c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4700066f30 0x7f47000693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 --2- 172.21.15.37:0/999501870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47140cb030 0x7f47140aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:21.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.854+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 >> 172.21.15.37:0/999501870 conn(0x7f47140c9540 msgr2=0x7f4714158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:21.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.855+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 shutdown_connections 2023-10-06T04:17:21.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.855+0000 7f471bd26700 1 -- 172.21.15.37:0/999501870 wait complete. 2023-10-06T04:17:21.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:21.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.990+0000 7f21853ba700 1 Processor -- start 2023-10-06T04:17:21.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.990+0000 7f21853ba700 1 -- start start 2023-10-06T04:17:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f21853ba700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21800b2860 0x7f21800b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f21853ba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f21800b2c30 0x7f21800cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f21853ba700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218015a210 con 0x7f21800cb9a0 2023-10-06T04:17:22.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f21853ba700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800c61b0 con 0x7f21800b2860 2023-10-06T04:17:22.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f21853ba700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800c55a0 con 0x7f21800b2c30 2023-10-06T04:17:22.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21800b2860 0x7f21800b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21800cb9a0 0x7f21800c6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54080/0 (socket says 172.21.15.37:54080) 2023-10-06T04:17:22.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217f7fe700 1 -- 172.21.15.37:0/980119532 learned_addr learned my addr 172.21.15.37:0/980119532 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:22.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217e7fc700 1 --2- 172.21.15.37:0/980119532 >> v2:172.21.15.83:3300/0 conn(0x7f21800b2c30 0x7f21800cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 -- 172.21.15.37:0/980119532 >> v2:172.21.15.83:3300/0 conn(0x7f21800b2c30 msgr2=0x7f21800cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:22.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 --2- 172.21.15.37:0/980119532 >> v2:172.21.15.83:3300/0 conn(0x7f21800b2c30 0x7f21800cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 -- 172.21.15.37:0/980119532 >> v1:172.21.15.37:6789/0 conn(0x7f21800cb9a0 legacy=0x7f21800c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 -- 172.21.15.37:0/980119532 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800c5880 con 0x7f21800b2860 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.991+0000 7f217effd700 1 --2- 172.21.15.37:0/980119532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21800b3440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21800c76e0 tx=0x7f2170009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab70699214c482e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f217dffb700 1 -- 172.21.15.37:0/980119532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000e070 con 0x7f21800b2860 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f217dffb700 1 -- 172.21.15.37:0/980119532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000ba60 con 0x7f21800b2860 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f217dffb700 1 -- 172.21.15.37:0/980119532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000be20 con 0x7f21800b2860 2023-10-06T04:17:22.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 -- 172.21.15.37:0/980119532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 msgr2=0x7f21800b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 --2- 172.21.15.37:0/980119532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21800b3440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21800c76e0 tx=0x7f2170009780 comp rx=0 tx=0).stop 2023-10-06T04:17:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 -- 172.21.15.37:0/980119532 shutdown_connections 2023-10-06T04:17:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 --2- 172.21.15.37:0/980119532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21800b3440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 --2- 172.21.15.37:0/980119532 >> v2:172.21.15.83:3300/0 conn(0x7f21800b2c30 0x7f21800cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 -- 172.21.15.37:0/980119532 >> 172.21.15.37:0/980119532 conn(0x7f218006f570 msgr2=0x7f21800d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 -- 172.21.15.37:0/980119532 shutdown_connections 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.992+0000 7f21853ba700 1 -- 172.21.15.37:0/980119532 wait complete. 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.993+0000 7f21853ba700 1 Processor -- start 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.993+0000 7f21853ba700 1 -- start start 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21800b2c30 0x7f21800c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21800cb9a0 0x7f21800c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218015f3a0 con 0x7f21800b2860 2023-10-06T04:17:22.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800ca820 con 0x7f21800b2c30 2023-10-06T04:17:22.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f21853ba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218015f070 con 0x7f21800cb9a0 2023-10-06T04:17:22.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f217effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f217effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55536/0 (socket says 172.21.15.37:55536) 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f217effd700 1 -- 172.21.15.37:0/500091490 learned_addr learned my addr 172.21.15.37:0/500091490 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f217e7fc700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21800b2c30 0x7f21800c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.994+0000 7f217f7fe700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21800cb9a0 0x7f21800c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 -- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21800cb9a0 msgr2=0x7f21800c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21800cb9a0 0x7f21800c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 -- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21800b2c30 msgr2=0x7f21800c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21800b2c30 0x7f21800c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 -- 172.21.15.37:0/500091490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009a20 con 0x7f21800b2860 2023-10-06T04:17:22.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f217effd700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2180064720 tx=0x7f2170018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170012e60 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217001b460 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800c8f70 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217001b5f0 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.995+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800c8c90 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.996+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218015eed0 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.996+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2170024020 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.997+0000 7f2176ffd700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 0x7f21600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.997+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2170086780 con 0x7f21800b2860 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.997+0000 7f217e7fc700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 0x7f21600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:21.997+0000 7f217e7fc700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 0x7f21600693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2180160840 tx=0x7f2168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.001+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f218015eed0 con 0x7f21800b2860 2023-10-06T04:17:22.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.193+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f218015eed0 con 0x7f21800b2860 2023-10-06T04:17:22.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.194+0000 7f2176ffd700 1 -- 172.21.15.37:0/500091490 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f218015eed0 con 0x7f21800b2860 2023-10-06T04:17:22.197 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 msgr2=0x7f21600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 0x7f21600693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2180160840 tx=0x7f2168008040 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 msgr2=0x7f21801554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2180064720 tx=0x7f2170018000 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 shutdown_connections 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f21800cb9a0 0x7f21800c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21800b2860 0x7f21801554f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2160066f30 0x7f21600693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 --2- 172.21.15.37:0/500091490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21800b2c30 0x7f21800c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 >> 172.21.15.37:0/500091490 conn(0x7f218006f570 msgr2=0x7f2180068be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 shutdown_connections 2023-10-06T04:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.196+0000 7f21853ba700 1 -- 172.21.15.37:0/500091490 wait complete. 2023-10-06T04:17:22.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.330+0000 7f0c12286700 1 Processor -- start 2023-10-06T04:17:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 -- start start 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0ce260 0x7f0c0c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c0ceff0 0x7f0c0c0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c0cdb20 con 0x7f0c0c159dc0 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c0cf9d0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c12286700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0b3090 con 0x7f0c0c0ceff0 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c0b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0c0ce260 0x7f0c0c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.331+0000 7f0c0bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c0c159dc0 0x7f0c0c0ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54094/0 (socket says 172.21.15.37:54094) 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0bfff700 1 -- 172.21.15.37:0/136562518 learned_addr learned my addr 172.21.15.37:0/136562518 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c10823700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c0ceff0 0x7f0c0c0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0b7fe700 1 -- 172.21.15.37:0/136562518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c0ceff0 msgr2=0x7f0c0c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0b7fe700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c0ceff0 0x7f0c0c0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0b7fe700 1 -- 172.21.15.37:0/136562518 >> v1:172.21.15.37:6789/0 conn(0x7f0c0c159dc0 legacy=0x7f0c0c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0b7fe700 1 -- 172.21.15.37:0/136562518 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0c5430 con 0x7f0c0c0ce260 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0affd700 1 -- 172.21.15.37:0/136562518 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065008000 0 0) 0x7f0c0c0cdb20 con 0x7f0c0c159dc0 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0b7fe700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c0cc6a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c000098e0 tx=0x7f0c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd3f2c440828ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0affd700 1 -- 172.21.15.37:0/136562518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000b640 con 0x7f0c0c0ce260 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0affd700 1 -- 172.21.15.37:0/136562518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0000b7a0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.332+0000 7f0c0affd700 1 -- 172.21.15.37:0/136562518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000bb40 con 0x7f0c0c0ce260 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 -- 172.21.15.37:0/136562518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 msgr2=0x7f0c0c0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c0cc6a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c000098e0 tx=0x7f0c000091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 -- 172.21.15.37:0/136562518 shutdown_connections 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c0ceff0 0x7f0c0c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 --2- 172.21.15.37:0/136562518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c0cc6a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 -- 172.21.15.37:0/136562518 >> 172.21.15.37:0/136562518 conn(0x7f0c0c099a50 msgr2=0x7f0c0c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 -- 172.21.15.37:0/136562518 shutdown_connections 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.333+0000 7f0c12286700 1 -- 172.21.15.37:0/136562518 wait complete. 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.334+0000 7f0c12286700 1 Processor -- start 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.334+0000 7f0c12286700 1 -- start start 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c0c0ceff0 0x7f0c0c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 0x7f0c0c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c9220 con 0x7f0c0c0ce260 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c9da0 con 0x7f0c0c0ceff0 2023-10-06T04:17:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c12286700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0c9470 con 0x7f0c0c159dc0 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55560/0 (socket says 172.21.15.37:55560) 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 -- 172.21.15.37:0/3511411541 learned_addr learned my addr 172.21.15.37:0/3511411541 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c10823700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 0x7f0c0c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0b7fe700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c0c0ceff0 0x7f0c0c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 -- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 msgr2=0x7f0c0c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 0x7f0c0c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 -- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c0c0ceff0 msgr2=0x7f0c0c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c0c0ceff0 0x7f0c0c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 -- 172.21.15.37:0/3511411541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00009420 con 0x7f0c0c0ce260 2023-10-06T04:17:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c10823700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 0x7f0c0c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0c0bfff700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c7e0 tx=0x7f0bfc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.335+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc007300 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.336+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc007460 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.336+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c0c9750 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.336+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0057f0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.336+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c1576b0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.336+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c0ca080 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.337+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bfc005ba0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.337+0000 7f0bf3fff700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.337+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0bfc084100 con 0x7f0c0c0ce260 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.337+0000 7f0c0b7fe700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.338+0000 7f0c0b7fe700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 0x7f0bf80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0ce6c0 tx=0x7f0c00017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.343+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bfc051290 con 0x7f0c0c0ce260 2023-10-06T04:17:22.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.533+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c0c04c3c0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.534+0000 7f0bf3fff700 1 -- 172.21.15.37:0/3511411541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0bfc0548b0 con 0x7f0c0c0ce260 2023-10-06T04:17:22.536 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:22.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 msgr2=0x7f0bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 0x7f0bf80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0ce6c0 tx=0x7f0c00017000 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 msgr2=0x7f0c0c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c7e0 tx=0x7f0bfc007c80 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 shutdown_connections 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0c0c159dc0 0x7f0c0c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0c0ce260 0x7f0c0c157170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0bf8066f30 0x7f0bf80693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 --2- 172.21.15.37:0/3511411541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c0c0ceff0 0x7f0c0c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 >> 172.21.15.37:0/3511411541 conn(0x7f0c0c099a50 msgr2=0x7f0c0c0d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 shutdown_connections 2023-10-06T04:17:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.536+0000 7f0c12286700 1 -- 172.21.15.37:0/3511411541 wait complete. 2023-10-06T04:17:22.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:22.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.670+0000 7f6afc78f700 1 Processor -- start 2023-10-06T04:17:22.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.670+0000 7f6afc78f700 1 -- start start 2023-10-06T04:17:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afc78f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 0x7f6af40cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afc78f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40cdb20 con 0x7f6af4159dc0 2023-10-06T04:17:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afc78f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40c5430 con 0x7f6af40ce260 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afc78f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40b3090 con 0x7f6af40cf700 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afa52b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6af4159dc0 0x7f6af40ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54106/0 (socket says 172.21.15.37:54106) 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afa52b700 1 -- 172.21.15.37:0/577599306 learned_addr learned my addr 172.21.15.37:0/577599306 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.671+0000 7f6afad2c700 1 --2- 172.21.15.37:0/577599306 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 0x7f6af40cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182974538 0 0) 0x7f6af40cdb20 con 0x7f6af4159dc0 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003570 con 0x7f6af4159dc0 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106986675 0 0) 0x7f6af40c5430 con 0x7f6af40ce260 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af40cdb20 con 0x7f6af40ce260 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6afad2c700 1 -- 172.21.15.37:0/577599306 >> v1:172.21.15.83:6789/0 conn(0x7f6af40ce260 legacy=0x7f6af40ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6afad2c700 1 -- 172.21.15.37:0/577599306 >> v1:172.21.15.37:6789/0 conn(0x7f6af4159dc0 legacy=0x7f6af40ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6afad2c700 1 -- 172.21.15.37:0/577599306 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40c6290 con 0x7f6af40cf700 2023-10-06T04:17:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6afad2c700 1 --2- 172.21.15.37:0/577599306 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 0x7f6af40cc6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009e90 tx=0x7f6ae4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b913f844b85bc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400e070 con 0x7f6af40cf700 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400bb80 con 0x7f6af40cf700 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.672+0000 7f6af9529700 1 -- 172.21.15.37:0/577599306 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4012430 con 0x7f6af40cf700 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 -- 172.21.15.37:0/577599306 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 msgr2=0x7f6af40cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 --2- 172.21.15.37:0/577599306 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 0x7f6af40cc6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009e90 tx=0x7f6ae4009780 comp rx=0 tx=0).stop 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 -- 172.21.15.37:0/577599306 shutdown_connections 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 --2- 172.21.15.37:0/577599306 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40cf700 0x7f6af40cc6a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 -- 172.21.15.37:0/577599306 >> 172.21.15.37:0/577599306 conn(0x7f6af4099a50 msgr2=0x7f6af406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 -- 172.21.15.37:0/577599306 shutdown_connections 2023-10-06T04:17:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.673+0000 7f6afc78f700 1 -- 172.21.15.37:0/577599306 wait complete. 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.674+0000 7f6afc78f700 1 Processor -- start 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.674+0000 7f6afc78f700 1 -- start start 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.674+0000 7f6afc78f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40ce260 0x7f6af4157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.674+0000 7f6afc78f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af40cf700 0x7f6af40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40cab40 con 0x7f6af4159dc0 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c9f30 con 0x7f6af40cf700 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40ca210 con 0x7f6af40ce260 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55566/0 (socket says 172.21.15.37:55566) 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 -- 172.21.15.37:0/2477561267 learned_addr learned my addr 172.21.15.37:0/2477561267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6af9d2a700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af40cf700 0x7f6af40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afa52b700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40ce260 0x7f6af4157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 -- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40ce260 msgr2=0x7f6af4157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40ce260 0x7f6af4157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 -- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af40cf700 msgr2=0x7f6af40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af40cf700 0x7f6af40c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 -- 172.21.15.37:0/2477561267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009a20 con 0x7f6af4159dc0 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afad2c700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4013000 tx=0x7f6ae4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4012e00 con 0x7f6af4159dc0 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae401d630 con 0x7f6af4159dc0 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40ca4f0 con 0x7f6af4159dc0 2023-10-06T04:17:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae401d9f0 con 0x7f6af4159dc0 2023-10-06T04:17:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.675+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af40c90b0 con 0x7f6af4159dc0 2023-10-06T04:17:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.676+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af404c3c0 con 0x7f6af4159dc0 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.677+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ae4024070 con 0x7f6af4159dc0 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.677+0000 7f6af27fc700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.677+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ae4086f10 con 0x7f6af4159dc0 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.677+0000 7f6afa52b700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.678+0000 7f6afa52b700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007fd0 tx=0x7f6aec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.681+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ae4054020 con 0x7f6af4159dc0 2023-10-06T04:17:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.873+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6af4067fd0 con 0x7f6af4159dc0 2023-10-06T04:17:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.874+0000 7f6af27fc700 1 -- 172.21.15.37:0/2477561267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ae4057640 con 0x7f6af4159dc0 2023-10-06T04:17:22.877 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 msgr2=0x7f6ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007fd0 tx=0x7f6aec009040 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 msgr2=0x7f6af40b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4013000 tx=0x7f6ae4019000 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 shutdown_connections 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af4159dc0 0x7f6af40b1780 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6af40ce260 0x7f6af4157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 --2- 172.21.15.37:0/2477561267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6af40cf700 0x7f6af40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 >> 172.21.15.37:0/2477561267 conn(0x7f6af4099a50 msgr2=0x7f6af40ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 shutdown_connections 2023-10-06T04:17:22.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:22.876+0000 7f6afc78f700 1 -- 172.21.15.37:0/2477561267 wait complete. 2023-10-06T04:17:22.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.010+0000 7fbd4581d700 1 Processor -- start 2023-10-06T04:17:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.010+0000 7fbd4581d700 1 -- start start 2023-10-06T04:17:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd400d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd400cb2a0 0x7fbd400cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400b3b00 con 0x7fbd400caed0 2023-10-06T04:17:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd400cc010 con 0x7fbd400cb2a0 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400cc2f0 con 0x7fbd4015d410 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd400cb2a0 0x7fbd400cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd400cb2a0 0x7fbd400cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55570/0 (socket says 172.21.15.37:55570) 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 -- 172.21.15.37:0/3242859366 learned_addr learned my addr 172.21.15.37:0/3242859366 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3e7fc700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd400d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 -- 172.21.15.37:0/3242859366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 msgr2=0x7fbd400d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd400d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 -- 172.21.15.37:0/3242859366 >> v1:172.21.15.83:6789/0 conn(0x7fbd400caed0 legacy=0x7fbd4015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 -- 172.21.15.37:0/3242859366 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400b34b0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3f7fe700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd400cb740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009f20 tx=0x7fbd30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b7d90727349d15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3dffb700 1 -- 172.21.15.37:0/3242859366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000e070 con 0x7fbd400cb2a0 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3dffb700 1 -- 172.21.15.37:0/3242859366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3000b9d0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd3dffb700 1 -- 172.21.15.37:0/3242859366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300092e0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- 172.21.15.37:0/3242859366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 msgr2=0x7fbd400cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd400cb740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009f20 tx=0x7fbd30009840 comp rx=0 tx=0).stop 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- 172.21.15.37:0/3242859366 shutdown_connections 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd400cb740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 --2- 172.21.15.37:0/3242859366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd400d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- 172.21.15.37:0/3242859366 >> 172.21.15.37:0/3242859366 conn(0x7fbd4006f570 msgr2=0x7fbd400d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- 172.21.15.37:0/3242859366 shutdown_connections 2023-10-06T04:17:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.012+0000 7fbd4581d700 1 -- 172.21.15.37:0/3242859366 wait complete. 2023-10-06T04:17:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 Processor -- start 2023-10-06T04:17:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 -- start start 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd400caed0 0x7fbd4016cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd4016afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4016c950 con 0x7fbd400cb2a0 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4016bd40 con 0x7fbd400caed0 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd4581d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4016c020 con 0x7fbd4015d410 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd3e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd3e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55576/0 (socket says 172.21.15.37:55576) 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd3e7fc700 1 -- 172.21.15.37:0/1172481513 learned_addr learned my addr 172.21.15.37:0/1172481513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.014+0000 7fbd3f7fe700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd4016afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3effd700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd400caed0 0x7fbd4016cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 -- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 msgr2=0x7fbd4016afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd4016afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 -- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd400caed0 msgr2=0x7fbd4016cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd400caed0 0x7fbd4016cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 -- 172.21.15.37:0/1172481513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009ae0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd3e7fc700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800ec80 tx=0x7fbd280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800c850 con 0x7fbd400cb2a0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2800c9b0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4016c300 con 0x7fbd400cb2a0 2023-10-06T04:17:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800cd50 con 0x7fbd400cb2a0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.015+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4015c0f0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.016+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4016cb00 con 0x7fbd400cb2a0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.016+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd28013680 con 0x7fbd400cb2a0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.017+0000 7fbd36ffd700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 0x7fbd200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.017+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd28084890 con 0x7fbd400cb2a0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.017+0000 7fbd3effd700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 0x7fbd200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.017+0000 7fbd3effd700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 0x7fbd200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd38007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.022+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd4016cb00 con 0x7fbd400cb2a0 2023-10-06T04:17:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.214+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd4004c3c0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.215+0000 7fbd36ffd700 1 -- 172.21.15.37:0/1172481513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd280519a0 con 0x7fbd400cb2a0 2023-10-06T04:17:23.217 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 msgr2=0x7fbd200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 0x7fbd200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd38007ef0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 msgr2=0x7fbd4015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800ec80 tx=0x7fbd280091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 shutdown_connections 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd4015d410 0x7fbd4016afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbd20066f30 0x7fbd200693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd400caed0 0x7fbd4016cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 --2- 172.21.15.37:0/1172481513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd400cb2a0 0x7fbd4015bbb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 >> 172.21.15.37:0/1172481513 conn(0x7fbd4006f570 msgr2=0x7fbd400cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 shutdown_connections 2023-10-06T04:17:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.217+0000 7fbd4581d700 1 -- 172.21.15.37:0/1172481513 wait complete. 2023-10-06T04:17:23.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.348+0000 7f8c628f6700 1 Processor -- start 2023-10-06T04:17:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.348+0000 7f8c628f6700 1 -- start start 2023-10-06T04:17:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c628f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c628f6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8c5c0ad800 0x7f8c5c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c628f6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c0ae9f0 con 0x7f8c5c0b6200 2023-10-06T04:17:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c628f6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c0adde0 con 0x7f8c5c0ad800 2023-10-06T04:17:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c628f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0ae0c0 con 0x7f8c5c0b5e30 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c5bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8c5c0ad800 0x7f8c5c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8c5c0ad800 0x7f8c5c15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:47106/0 (socket says 172.21.15.37:47106) 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c5b7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8c5c0b6200 0x7f8c5c0ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:34112/0 (socket says 172.21.15.37:34112) 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 -- 172.21.15.37:0/3132432733 learned_addr learned my addr 172.21.15.37:0/3132432733 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c5bfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:60214/0 (socket says 172.21.15.37:60214) 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 -- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 msgr2=0x7f8c5c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 -- 172.21.15.37:0/3132432733 >> v1:172.21.15.83:6789/0 conn(0x7f8c5c0b6200 legacy=0x7f8c5c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c5affd700 1 -- 172.21.15.37:0/3132432733 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397679551 0 0) 0x7f8c5c0ae9f0 con 0x7f8c5c0b6200 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c60e93700 1 -- 172.21.15.37:0/3132432733 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0ae3a0 con 0x7f8c5c0ad800 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.349+0000 7f8c5bfff700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c60e93700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0ad800 0x7f8c5c15daa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009f20 tx=0x7f8c54009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7af4a966c14a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c5affd700 1 -- 172.21.15.37:0/3132432733 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400e070 con 0x7f8c5c0ad800 2023-10-06T04:17:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c5affd700 1 -- 172.21.15.37:0/3132432733 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5400b9d0 con 0x7f8c5c0ad800 2023-10-06T04:17:23.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c5affd700 1 -- 172.21.15.37:0/3132432733 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540092e0 con 0x7f8c5c0ad800 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 -- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0ad800 msgr2=0x7f8c5c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0ad800 0x7f8c5c15daa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009f20 tx=0x7f8c54009840 comp rx=0 tx=0).stop 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 -- 172.21.15.37:0/3132432733 shutdown_connections 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0ad800 0x7f8c5c15daa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 --2- 172.21.15.37:0/3132432733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0b5e30 0x7f8c5c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 -- 172.21.15.37:0/3132432733 >> 172.21.15.37:0/3132432733 conn(0x7f8c5c099a10 msgr2=0x7f8c5c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 -- 172.21.15.37:0/3132432733 shutdown_connections 2023-10-06T04:17:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.350+0000 7f8c628f6700 1 -- 172.21.15.37:0/3132432733 wait complete. 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.351+0000 7f8c628f6700 1 Processor -- start 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 -- start start 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0ad800 0x7f8c5c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0b5e30 0x7f8c5c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c150970 con 0x7f8c5c0b6200 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15be50 con 0x7f8c5c0b5e30 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c628f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c1446d0 con 0x7f8c5c0ad800 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.352+0000 7f8c60e93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55582/0 (socket says 172.21.15.37:55582) 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 -- 172.21.15.37:0/345905824 learned_addr learned my addr 172.21.15.37:0/345905824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c5b7fe700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0b5e30 0x7f8c5c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c5bfff700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0ad800 0x7f8c5c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 -- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0ad800 msgr2=0x7f8c5c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0ad800 0x7f8c5c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 -- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0b5e30 msgr2=0x7f8c5c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0b5e30 0x7f8c5c151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 -- 172.21.15.37:0/345905824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009420 con 0x7f8c5c0b6200 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c60e93700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c088cb0 tx=0x7f8c54018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54003300 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54007bf0 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c54009ae0 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5401d420 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.353+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c15c0f0 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.354+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c068690 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.354+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c54003050 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.355+0000 7f8c53fff700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 0x7f8c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.355+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c54086380 con 0x7f8c5c0b6200 2023-10-06T04:17:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.355+0000 7f8c5bfff700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 0x7f8c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.356+0000 7f8c5bfff700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 0x7f8c3c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0093f0 tx=0x7f8c4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.360+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c5c068690 con 0x7f8c5c0b6200 2023-10-06T04:17:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.554+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c5c068690 con 0x7f8c5c0b6200 2023-10-06T04:17:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.555+0000 7f8c53fff700 1 -- 172.21.15.37:0/345905824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f8c5c068690 con 0x7f8c5c0b6200 2023-10-06T04:17:23.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:23.558 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 msgr2=0x7f8c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 0x7f8c3c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0093f0 tx=0x7f8c4c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 msgr2=0x7f8c5c144190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c088cb0 tx=0x7f8c54018000 comp rx=0 tx=0).stop 2023-10-06T04:17:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 shutdown_connections 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5c0b6200 0x7f8c5c144190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8c5c0ad800 0x7f8c5c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8c3c066f30 0x7f8c3c0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 --2- 172.21.15.37:0/345905824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c5c0b5e30 0x7f8c5c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 >> 172.21.15.37:0/345905824 conn(0x7f8c5c099a10 msgr2=0x7f8c5c151140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 shutdown_connections 2023-10-06T04:17:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.558+0000 7f8c628f6700 1 -- 172.21.15.37:0/345905824 wait complete. 2023-10-06T04:17:23.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:23.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 Processor -- start 2023-10-06T04:17:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 -- start start 2023-10-06T04:17:23.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac181539c0 0x7fac18159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 0x7fac180d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180b51a0 con 0x7fac18153d90 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac180d0cc0 con 0x7fac181539c0 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.694+0000 7fac1cf6d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac180b5ff0 con 0x7fac180d02e0 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac181539c0 0x7fac18159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac17fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 0x7fac180d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac181539c0 0x7fac18159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:47136/0 (socket says 172.21.15.37:47136) 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac16ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fac18153d90 0x7fac180b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:34118/0 (socket says 172.21.15.37:34118) 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 -- 172.21.15.37:0/4000070771 learned_addr learned my addr 172.21.15.37:0/4000070771 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac17fff700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 0x7fac180d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:60222/0 (socket says 172.21.15.37:60222) 2023-10-06T04:17:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 -- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 msgr2=0x7fac180d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 0x7fac180d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 -- 172.21.15.37:0/4000070771 >> v1:172.21.15.83:6789/0 conn(0x7fac18153d90 legacy=0x7fac180b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 -- 172.21.15.37:0/4000070771 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180b53e0 con 0x7fac181539c0 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac177fe700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac181539c0 0x7fac18159b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac080099b0 tx=0x7fac08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=415ed15b6a8b5ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.695+0000 7fac167fc700 1 -- 172.21.15.37:0/4000070771 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08009ea0 con 0x7fac181539c0 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac167fc700 1 -- 172.21.15.37:0/4000070771 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800b860 con 0x7fac181539c0 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac167fc700 1 -- 172.21.15.37:0/4000070771 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800bc00 con 0x7fac181539c0 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 -- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac181539c0 msgr2=0x7fac18159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac181539c0 0x7fac18159b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac080099b0 tx=0x7fac08009250 comp rx=0 tx=0).stop 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 -- 172.21.15.37:0/4000070771 shutdown_connections 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac180d02e0 0x7fac180d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/4000070771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac181539c0 0x7fac18159b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 -- 172.21.15.37:0/4000070771 >> 172.21.15.37:0/4000070771 conn(0x7fac1806ed90 msgr2=0x7fac1806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 -- 172.21.15.37:0/4000070771 shutdown_connections 2023-10-06T04:17:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.696+0000 7fac1cf6d700 1 -- 172.21.15.37:0/4000070771 wait complete. 2023-10-06T04:17:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.697+0000 7fac1cf6d700 1 Processor -- start 2023-10-06T04:17:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.697+0000 7fac1cf6d700 1 -- start start 2023-10-06T04:17:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac181539c0 0x7fac18169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac18153d90 0x7fac18158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18159740 con 0x7fac180d02e0 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1816aef0 con 0x7fac18153d90 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac1cf6d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1816b1d0 con 0x7fac181539c0 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55588/0 (socket says 172.21.15.37:55588) 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac177fe700 1 -- 172.21.15.37:0/2983853633 learned_addr learned my addr 172.21.15.37:0/2983853633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac16ffd700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac181539c0 0x7fac18169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.698+0000 7fac17fff700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac18153d90 0x7fac18158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 -- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac181539c0 msgr2=0x7fac18169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac181539c0 0x7fac18169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 -- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac18153d90 msgr2=0x7fac18158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac18153d90 0x7fac18158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 -- 172.21.15.37:0/2983853633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080094f0 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac177fe700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fac18067fe0 tx=0x7fac08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08000d10 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800bbe0 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1816b4b0 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08011670 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.699+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1816ba70 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.700+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac180cd520 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.700+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac08011aa0 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.701+0000 7fabff7fe700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 0x7fac040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.701+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac08085f40 con 0x7fac180d02e0 2023-10-06T04:17:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.701+0000 7fac16ffd700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 0x7fac040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:23.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.701+0000 7fac16ffd700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 0x7fac040693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac18151f50 tx=0x7fac0c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.705+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac08052fb0 con 0x7fac180d02e0 2023-10-06T04:17:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.898+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac1804c3c0 con 0x7fac180d02e0 2023-10-06T04:17:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.898+0000 7fabff7fe700 1 -- 172.21.15.37:0/2983853633 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac080565d0 con 0x7fac180d02e0 2023-10-06T04:17:23.900 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 msgr2=0x7fac040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 0x7fac040693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac18151f50 tx=0x7fac0c007eb0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 msgr2=0x7fac18167430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fac18067fe0 tx=0x7fac08017000 comp rx=0 tx=0).stop 2023-10-06T04:17:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 shutdown_connections 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac04066f30 0x7fac040693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac18153d90 0x7fac18158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac180d02e0 0x7fac18167430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 --2- 172.21.15.37:0/2983853633 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac181539c0 0x7fac18169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 >> 172.21.15.37:0/2983853633 conn(0x7fac1806ed90 msgr2=0x7fac18152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 shutdown_connections 2023-10-06T04:17:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:23.901+0000 7fac1cf6d700 1 -- 172.21.15.37:0/2983853633 wait complete. 2023-10-06T04:17:23.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.035+0000 7f3c9c016700 1 Processor -- start 2023-10-06T04:17:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.035+0000 7f3c9c016700 1 -- start start 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9c016700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c94159dc0 0x7f3c940ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9c016700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c940cf700 0x7f3c940cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9c016700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940cdb20 con 0x7f3c940ce260 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9c016700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c940b3090 con 0x7f3c940cf700 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9c016700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c5430 con 0x7f3c94159dc0 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c940cf700 0x7f3c940cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c940cf700 0x7f3c940cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55590/0 (socket says 172.21.15.37:55590) 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 -- 172.21.15.37:0/3192210839 learned_addr learned my addr 172.21.15.37:0/3192210839 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c99db2700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c94159dc0 0x7f3c940ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 -- 172.21.15.37:0/3192210839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c94159dc0 msgr2=0x7f3c940ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c94159dc0 0x7f3c940ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 -- 172.21.15.37:0/3192210839 >> v1:172.21.15.83:6789/0 conn(0x7f3c940ce260 legacy=0x7f3c940ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 -- 172.21.15.37:0/3192210839 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940c6290 con 0x7f3c940cf700 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c9a5b3700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940cc6a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0099b0 tx=0x7f3c8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b81eea4b0e06e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.036+0000 7f3c98db0700 1 -- 172.21.15.37:0/3192210839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00b860 con 0x7f3c940cf700 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c98db0700 1 -- 172.21.15.37:0/3192210839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c00b9c0 con 0x7f3c940cf700 2023-10-06T04:17:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c98db0700 1 -- 172.21.15.37:0/3192210839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00bd60 con 0x7f3c940cf700 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 -- 172.21.15.37:0/3192210839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 msgr2=0x7f3c940cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940cc6a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0099b0 tx=0x7f3c8c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 -- 172.21.15.37:0/3192210839 shutdown_connections 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940cc6a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 --2- 172.21.15.37:0/3192210839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c94159dc0 0x7f3c940ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 -- 172.21.15.37:0/3192210839 >> 172.21.15.37:0/3192210839 conn(0x7f3c94099a50 msgr2=0x7f3c9406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 -- 172.21.15.37:0/3192210839 shutdown_connections 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.037+0000 7f3c9c016700 1 -- 172.21.15.37:0/3192210839 wait complete. 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.038+0000 7f3c9c016700 1 Processor -- start 2023-10-06T04:17:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.038+0000 7f3c9c016700 1 -- start start 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c940ce260 0x7f3c9409dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c94159dc0 0x7f3c94147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9409e190 con 0x7f3c940cf700 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c9d20 con 0x7f3c94159dc0 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9c016700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9409a6c0 con 0x7f3c940ce260 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55602/0 (socket says 172.21.15.37:55602) 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 -- 172.21.15.37:0/2160071545 learned_addr learned my addr 172.21.15.37:0/2160071545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c99db2700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c940ce260 0x7f3c9409dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c9a5b3700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c94159dc0 0x7f3c94147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 -- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c940ce260 msgr2=0x7f3c9409dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c940ce260 0x7f3c9409dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 -- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c94159dc0 msgr2=0x7f3c94147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c94159dc0 0x7f3c94147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.039+0000 7f3c995b1700 1 -- 172.21.15.37:0/2160071545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0094f0 con 0x7f3c940cf700 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c995b1700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c5c0 tx=0x7f3c8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011590 con 0x7f3c940cf700 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88011710 con 0x7f3c940cf700 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011ad0 con 0x7f3c940cf700 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c940c9f50 con 0x7f3c940cf700 2023-10-06T04:17:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.040+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9409a350 con 0x7f3c940cf700 2023-10-06T04:17:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.041+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9404c3c0 con 0x7f3c940cf700 2023-10-06T04:17:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.041+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c8801b3b0 con 0x7f3c940cf700 2023-10-06T04:17:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.042+0000 7f3c91ffb700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 0x7f3c800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.042+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c88083b10 con 0x7f3c940cf700 2023-10-06T04:17:24.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.042+0000 7f3c99db2700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 0x7f3c800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.042+0000 7f3c99db2700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 0x7f3c800693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009fd0 tx=0x7f3c84009800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.046+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c88050c20 con 0x7f3c940cf700 2023-10-06T04:17:24.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:17:24.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:17:24.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.242+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3c9409a800 con 0x7f3c940cf700 2023-10-06T04:17:24.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.243+0000 7f3c91ffb700 1 -- 172.21.15.37:0/2160071545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3c88017070 con 0x7f3c940cf700 2023-10-06T04:17:24.244 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.244+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 msgr2=0x7f3c800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.244+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 0x7f3c800693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009fd0 tx=0x7f3c84009800 comp rx=0 tx=0).stop 2023-10-06T04:17:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.244+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 msgr2=0x7f3c940c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.244+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c5c0 tx=0x7f3c8800c8d0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 shutdown_connections 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3c80066f30 0x7f3c800693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c94159dc0 0x7f3c94147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3c940ce260 0x7f3c9409dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 --2- 172.21.15.37:0/2160071545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c940cf700 0x7f3c940c97e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 >> 172.21.15.37:0/2160071545 conn(0x7f3c94099a50 msgr2=0x7f3c94069470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 shutdown_connections 2023-10-06T04:17:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.245+0000 7f3c9c016700 1 -- 172.21.15.37:0/2160071545 wait complete. 2023-10-06T04:17:24.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.378+0000 7f9ff1150700 1 Processor -- start 2023-10-06T04:17:24.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.378+0000 7f9ff1150700 1 -- start start 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9ff1150700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fec0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9ff1150700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0cdb20 con 0x7f9fec0ce260 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9ff1150700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0c5430 con 0x7f9fec0cf700 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9ff1150700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b3090 con 0x7f9fec159dc0 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9fea59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9fec0ce260 0x7f9fec0ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54110/0 (socket says 172.21.15.37:54110) 2023-10-06T04:17:24.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9fea59c700 1 -- 172.21.15.37:0/4101999497 learned_addr learned my addr 172.21.15.37:0/4101999497 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596957045 0 0) 0x7f9fec0cdb20 con 0x7f9fec0ce260 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9fead9d700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fec0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.379+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd8003570 con 0x7f9fec0ce260 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1390185872 0 0) 0x7f9fd8003570 con 0x7f9fec0ce260 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 msgr2=0x7f9fec0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fec0ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 >> v1:172.21.15.83:6789/0 conn(0x7f9fec0cf700 legacy=0x7f9fec0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0c6290 con 0x7f9fec0ce260 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f9fd4001470 con 0x7f9fec0ce260 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 >> v1:172.21.15.37:6789/0 conn(0x7f9fec0ce260 legacy=0x7f9fec0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fd8003a90 0x7f9fd8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd8004d50 0x7f9fd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b3090 con 0x7f9fd8004d50 2023-10-06T04:17:24.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bb70 con 0x7f9fd8003a90 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bd30 con 0x7f9fec159dc0 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd8004d50 0x7f9fd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fead9d700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fd8003a90 0x7f9fd8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fea59c700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 -- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 msgr2=0x7f9fd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fec159dc0 0x7f9fd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 -- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fd8003a90 msgr2=0x7f9fd8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fd8003a90 0x7f9fd8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 -- 172.21.15.37:0/4101999497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8003570 con 0x7f9fd8004d50 2023-10-06T04:17:24.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9feb59e700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd8004d50 0x7f9fd80051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0cfb00 tx=0x7f9fdc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb21eff3b5d2840 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.380+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc001950 con 0x7f9fd8004d50 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc004030 con 0x7f9fd8004d50 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9fe9d9b700 1 -- 172.21.15.37:0/4101999497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00cae0 con 0x7f9fd8004d50 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 -- 172.21.15.37:0/4101999497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd8004d50 msgr2=0x7f9fd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 --2- 172.21.15.37:0/4101999497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd8004d50 0x7f9fd80051c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0cfb00 tx=0x7f9fdc001640 comp rx=0 tx=0).stop 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9feb59e700 1 -- 172.21.15.37:0/4101999497 reap_dead start 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 -- 172.21.15.37:0/4101999497 shutdown_connections 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 -- 172.21.15.37:0/4101999497 >> 172.21.15.37:0/4101999497 conn(0x7f9fec099a50 msgr2=0x7f9fec06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 -- 172.21.15.37:0/4101999497 shutdown_connections 2023-10-06T04:17:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.381+0000 7f9ff1150700 1 -- 172.21.15.37:0/4101999497 wait complete. 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.382+0000 7f9ff1150700 1 Processor -- start 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.382+0000 7f9ff1150700 1 -- start start 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 0x7f9fec14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1528e0 0x7f9fec152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec150490 con 0x7f9fec0b5440 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec156780 con 0x7f9fec1528e0 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9ff1150700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b5df0 con 0x7f9fd8004d50 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55622/0 (socket says 172.21.15.37:55622) 2023-10-06T04:17:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 -- 172.21.15.37:0/2808335821 learned_addr learned my addr 172.21.15.37:0/2808335821 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9fea59c700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1528e0 0x7f9fec152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9fead9d700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 0x7f9fec14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 -- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 msgr2=0x7f9fec14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 0x7f9fec14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 -- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1528e0 msgr2=0x7f9fec152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1528e0 0x7f9fec152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9feb59e700 1 -- 172.21.15.37:0/2808335821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec1538f0 con 0x7f9fec0b5440 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.383+0000 7f9fead9d700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 0x7f9fec14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9feb59e700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800bb40 tx=0x7f9fdc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc024070 con 0x7f9fec0b5440 2023-10-06T04:17:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc00c6d0 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec156d20 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc001950 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.384+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec153610 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.385+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec156eb0 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.385+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fdc01f620 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.386+0000 7f9fe2ffd700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.386+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fdc085d40 con 0x7f9fec0b5440 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.386+0000 7f9fead9d700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.386+0000 7f9fead9d700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006ea0 tx=0x7f9fe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.390+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fdc052e50 con 0x7f9fec0b5440 2023-10-06T04:17:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.581+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fec156eb0 con 0x7f9fec0b5440 2023-10-06T04:17:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.581+0000 7f9fe2ffd700 1 -- 172.21.15.37:0/2808335821 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9fdc017070 con 0x7f9fec0b5440 2023-10-06T04:17:24.583 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:24.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 msgr2=0x7f9fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 0x7f9fcc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006ea0 tx=0x7f9fe4008040 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 msgr2=0x7f9fec0b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800bb40 tx=0x7f9fdc015000 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 shutdown_connections 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fec0b5440 0x7f9fec0b58b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9fd8004d50 0x7f9fec14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9fcc066f30 0x7f9fcc0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 --2- 172.21.15.37:0/2808335821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fec1528e0 0x7f9fec152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 >> 172.21.15.37:0/2808335821 conn(0x7f9fec099a50 msgr2=0x7f9fec0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 shutdown_connections 2023-10-06T04:17:24.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.583+0000 7f9ff1150700 1 -- 172.21.15.37:0/2808335821 wait complete. 2023-10-06T04:17:24.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.718+0000 7f6028a08700 1 Processor -- start 2023-10-06T04:17:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.718+0000 7f6028a08700 1 -- start start 2023-10-06T04:17:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6028a08700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60240b2860 0x7f60240b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6028a08700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 0x7f60240cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6028a08700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602415a210 con 0x7f60240b2c30 2023-10-06T04:17:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6028a08700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240c61b0 con 0x7f60240b2860 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6028a08700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c55a0 con 0x7f60240cbb70 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f602259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60240b2860 0x7f60240b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6021d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60240b2c30 0x7f60240cb460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54118/0 (socket says 172.21.15.37:54118) 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f602259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60240b2860 0x7f60240b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55634/0 (socket says 172.21.15.37:55634) 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.719+0000 7f6021d9b700 1 -- 172.21.15.37:0/1580507222 learned_addr learned my addr 172.21.15.37:0/1580507222 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f6022d9d700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 0x7f60240cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602259c700 1 -- 172.21.15.37:0/1580507222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 msgr2=0x7f60240cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602259c700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 0x7f60240cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602259c700 1 -- 172.21.15.37:0/1580507222 >> v1:172.21.15.37:6789/0 conn(0x7f60240b2c30 legacy=0x7f60240cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602259c700 1 -- 172.21.15.37:0/1580507222 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240c5880 con 0x7f60240b2860 2023-10-06T04:17:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602159a700 1 -- 172.21.15.37:0/1580507222 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359831305 0 0) 0x7f602415a210 con 0x7f60240b2c30 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f6022d9d700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 0x7f60240cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602259c700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240b2860 0x7f60240b3440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098e0 tx=0x7f601c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e0cd27bdfa90d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602159a700 1 -- 172.21.15.37:0/1580507222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c009e80 con 0x7f60240b2860 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602159a700 1 -- 172.21.15.37:0/1580507222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00b860 con 0x7f60240b2860 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.720+0000 7f602159a700 1 -- 172.21.15.37:0/1580507222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00bbe0 con 0x7f60240b2860 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 -- 172.21.15.37:0/1580507222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240b2860 msgr2=0x7f60240b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240b2860 0x7f60240b3440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098e0 tx=0x7f601c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 -- 172.21.15.37:0/1580507222 shutdown_connections 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240cbb70 0x7f60240cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 --2- 172.21.15.37:0/1580507222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240b2860 0x7f60240b3440 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 -- 172.21.15.37:0/1580507222 >> 172.21.15.37:0/1580507222 conn(0x7f602406f570 msgr2=0x7f60240d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 -- 172.21.15.37:0/1580507222 shutdown_connections 2023-10-06T04:17:24.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.721+0000 7f6028a08700 1 -- 172.21.15.37:0/1580507222 wait complete. 2023-10-06T04:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.722+0000 7f6028a08700 1 Processor -- start 2023-10-06T04:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.722+0000 7f6028a08700 1 -- start start 2023-10-06T04:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240b2860 0x7f602415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60240b2c30 0x7f602415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024143e80 con 0x7f60240cbb70 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241575e0 con 0x7f60240b2c30 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602415a790 con 0x7f60240b2860 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55640/0 (socket says 172.21.15.37:55640) 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 -- 172.21.15.37:0/2576285164 learned_addr learned my addr 172.21.15.37:0/2576285164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6021d9b700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60240b2c30 0x7f602415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f602259c700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240b2860 0x7f602415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 -- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240b2860 msgr2=0x7f602415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240b2860 0x7f602415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 -- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60240b2c30 msgr2=0x7f602415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60240b2c30 0x7f602415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 -- 172.21.15.37:0/2576285164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009420 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6022d9d700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f601400d100 tx=0x7f60140099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400dc40 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400f040 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602415f4e0 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014015440 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.723+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602415fa70 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.724+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602404c3c0 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.725+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f601401e3b0 con 0x7f60240cbb70 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.725+0000 7f601a7fc700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 0x7f60040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.725+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6014084aa0 con 0x7f60240cbb70 2023-10-06T04:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.725+0000 7f602259c700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 0x7f60040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.726+0000 7f602259c700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 0x7f60040693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f601c0091e0 tx=0x7f601c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.730+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6014051bb0 con 0x7f60240cbb70 2023-10-06T04:17:24.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.923+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f602415a8d0 con 0x7f60240cbb70 2023-10-06T04:17:24.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.923+0000 7f601a7fc700 1 -- 172.21.15.37:0/2576285164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f601401a020 con 0x7f60240cbb70 2023-10-06T04:17:24.925 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 msgr2=0x7f60040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 0x7f60040693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f601c0091e0 tx=0x7f601c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 msgr2=0x7f60240c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f601400d100 tx=0x7f60140099b0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 shutdown_connections 2023-10-06T04:17:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60240cbb70 0x7f60240c94c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60240b2860 0x7f602415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6004066f30 0x7f60040693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 --2- 172.21.15.37:0/2576285164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60240b2c30 0x7f602415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 >> 172.21.15.37:0/2576285164 conn(0x7f602406f570 msgr2=0x7f60240b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 shutdown_connections 2023-10-06T04:17:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:24.925+0000 7f6028a08700 1 -- 172.21.15.37:0/2576285164 wait complete. 2023-10-06T04:17:24.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 Processor -- start 2023-10-06T04:17:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 -- start start 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc3415dc70 0x7fdc340ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340ae9f0 con 0x7fdc340b5e30 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340adde0 con 0x7fdc340b6200 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.056+0000 7fdc39f8f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340ae0c0 con 0x7fdc3415dc70 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc3415dc70 0x7fdc340ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc3415dc70 0x7fdc340ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55644/0 (socket says 172.21.15.37:55644) 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 -- 172.21.15.37:0/2817749586 learned_addr learned my addr 172.21.15.37:0/2817749586 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc337fe700 1 --1- 172.21.15.37:0/2817749586 >> v1:172.21.15.37:6789/0 conn(0x7fdc340b5e30 0x7fdc3415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54122/0 (socket says 172.21.15.37:54122) 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 -- 172.21.15.37:0/2817749586 >> v1:172.21.15.83:6789/0 conn(0x7fdc340b6200 legacy=0x7fdc340ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:25.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 -- 172.21.15.37:0/2817749586 >> v1:172.21.15.37:6789/0 conn(0x7fdc340b5e30 legacy=0x7fdc3415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 -- 172.21.15.37:0/2817749586 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340ae3a0 con 0x7fdc3415dc70 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc32ffd700 1 --2- 172.21.15.37:0/2817749586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc3415dc70 0x7fdc340ad0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823ec1ebc361e1b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc327fc700 1 -- 172.21.15.37:0/2817749586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800b820 con 0x7fdc3415dc70 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc327fc700 1 -- 172.21.15.37:0/2817749586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800b980 con 0x7fdc3415dc70 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.057+0000 7fdc327fc700 1 -- 172.21.15.37:0/2817749586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800bd20 con 0x7fdc3415dc70 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 -- 172.21.15.37:0/2817749586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc3415dc70 msgr2=0x7fdc340ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/2817749586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc3415dc70 0x7fdc340ad0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28009250 comp rx=0 tx=0).stop 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 -- 172.21.15.37:0/2817749586 shutdown_connections 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/2817749586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc3415dc70 0x7fdc340ad0f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 -- 172.21.15.37:0/2817749586 >> 172.21.15.37:0/2817749586 conn(0x7fdc34099a10 msgr2=0x7fdc3406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 -- 172.21.15.37:0/2817749586 shutdown_connections 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.058+0000 7fdc39f8f700 1 -- 172.21.15.37:0/2817749586 wait complete. 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.059+0000 7fdc39f8f700 1 Processor -- start 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.059+0000 7fdc39f8f700 1 -- start start 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc340b6200 0x7fdc3416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc3415dc70 0x7fdc34157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3409a4a0 con 0x7fdc340b5e30 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34154980 con 0x7fdc3415dc70 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc39f8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3415c470 con 0x7fdc340b6200 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55650/0 (socket says 172.21.15.37:55650) 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 -- 172.21.15.37:0/3232422956 learned_addr learned my addr 172.21.15.37:0/3232422956 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc32ffd700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc340b6200 0x7fdc3416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc33fff700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc3415dc70 0x7fdc34157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 -- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc340b6200 msgr2=0x7fdc3416ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc340b6200 0x7fdc3416ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 -- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc3415dc70 msgr2=0x7fdc34157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc3415dc70 0x7fdc34157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 -- 172.21.15.37:0/3232422956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280094f0 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.060+0000 7fdc337fe700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c7c0 tx=0x7fdc24007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24005a70 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24005bf0 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3415c750 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240070f0 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3415cd10 con 0x7fdc340b5e30 2023-10-06T04:17:25.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.061+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340b2f90 con 0x7fdc340b5e30 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.062+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc24007460 con 0x7fdc340b5e30 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.062+0000 7fdc1b7fe700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.062+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc24084140 con 0x7fdc340b5e30 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.063+0000 7fdc32ffd700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.063+0000 7fdc32ffd700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 0x7fdc200693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.067+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc240512d0 con 0x7fdc340b5e30 2023-10-06T04:17:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.260+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc34063410 con 0x7fdc340b5e30 2023-10-06T04:17:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.261+0000 7fdc1b7fe700 1 -- 172.21.15.37:0/3232422956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fdc240548f0 con 0x7fdc340b5e30 2023-10-06T04:17:25.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:25.263 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 msgr2=0x7fdc200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 0x7fdc200693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc280099b0 tx=0x7fdc28016000 comp rx=0 tx=0).stop 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 msgr2=0x7fdc34154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c7c0 tx=0x7fdc24007f70 comp rx=0 tx=0).stop 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 shutdown_connections 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fdc20066f30 0x7fdc200693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc3415dc70 0x7fdc34157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc340b5e30 0x7fdc34154440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 --2- 172.21.15.37:0/3232422956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc340b6200 0x7fdc3416ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 >> 172.21.15.37:0/3232422956 conn(0x7fdc34099a10 msgr2=0x7fdc34068690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 shutdown_connections 2023-10-06T04:17:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.263+0000 7fdc39f8f700 1 -- 172.21.15.37:0/3232422956 wait complete. 2023-10-06T04:17:25.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:25.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.397+0000 7f95b69c1700 1 Processor -- start 2023-10-06T04:17:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.397+0000 7f95b69c1700 1 -- start start 2023-10-06T04:17:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b69c1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b69c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95b00d02e0 0x7f95b00d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b69c1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00b51a0 con 0x7f95b01539c0 2023-10-06T04:17:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b69c1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00d0cc0 con 0x7f95b00d02e0 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b69c1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00b5ff0 con 0x7f95b0153d90 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95b00d02e0 0x7f95b00d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95b00d02e0 0x7f95b00d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55666/0 (socket says 172.21.15.37:55666) 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 -- 172.21.15.37:0/40272767 learned_addr learned my addr 172.21.15.37:0/40272767 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b51be700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 -- 172.21.15.37:0/40272767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 msgr2=0x7f95b0159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b0159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 -- 172.21.15.37:0/40272767 >> v1:172.21.15.83:6789/0 conn(0x7f95b01539c0 legacy=0x7f95b00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b49bd700 1 -- 172.21.15.37:0/40272767 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810366549 0 0) 0x7f95a8001110 con 0x7f95b01539c0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.398+0000 7f95b61c0700 1 -- 172.21.15.37:0/40272767 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00b53e0 con 0x7f95b00d02e0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b61c0700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b00d02e0 0x7f95b00d0780 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009f20 tx=0x7f95a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b4454805934a82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b49bd700 1 -- 172.21.15.37:0/40272767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000e070 con 0x7f95b00d02e0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b49bd700 1 -- 172.21.15.37:0/40272767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000b9d0 con 0x7f95b00d02e0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b49bd700 1 -- 172.21.15.37:0/40272767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a00092e0 con 0x7f95b00d02e0 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 -- 172.21.15.37:0/40272767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b00d02e0 msgr2=0x7f95b00d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b00d02e0 0x7f95b00d0780 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009f20 tx=0x7f95a0009840 comp rx=0 tx=0).stop 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 -- 172.21.15.37:0/40272767 shutdown_connections 2023-10-06T04:17:25.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b00d02e0 0x7f95b00d0780 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 --2- 172.21.15.37:0/40272767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.399+0000 7f95b69c1700 1 -- 172.21.15.37:0/40272767 >> 172.21.15.37:0/40272767 conn(0x7f95b006ed90 msgr2=0x7f95b006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.400+0000 7f95b69c1700 1 -- 172.21.15.37:0/40272767 shutdown_connections 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.400+0000 7f95b69c1700 1 -- 172.21.15.37:0/40272767 wait complete. 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 Processor -- start 2023-10-06T04:17:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 -- start start 2023-10-06T04:17:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b00d02e0 0x7f95b0158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01586e0 con 0x7f95b01539c0 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0157ad0 con 0x7f95b00d02e0 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b69c1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0157db0 con 0x7f95b0153d90 2023-10-06T04:17:25.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b51be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b51be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55670/0 (socket says 172.21.15.37:55670) 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b51be700 1 -- 172.21.15.37:0/3282787996 learned_addr learned my addr 172.21.15.37:0/3282787996 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b61c0700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.401+0000 7f95b59bf700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b00d02e0 0x7f95b0158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 -- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 msgr2=0x7f95b00b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b00b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 -- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b00d02e0 msgr2=0x7f95b0158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b00d02e0 0x7f95b0158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 -- 172.21.15.37:0/3282787996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009ae0 con 0x7f95b01539c0 2023-10-06T04:17:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b51be700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95a400c2a0 tx=0x7f95a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40159d0 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4015b30 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b0158090 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4016050 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.402+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b01576c0 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.403+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0158850 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.404+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95a4016400 con 0x7f95b01539c0 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.404+0000 7f95adffb700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.404+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f95a408c5f0 con 0x7f95b01539c0 2023-10-06T04:17:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.404+0000 7f95b59bf700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.405+0000 7f95b59bf700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 0x7f959c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001370 tx=0x7f95a8007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.408+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95a40575a0 con 0x7f95b01539c0 2023-10-06T04:17:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.602+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95b004c3c0 con 0x7f95b01539c0 2023-10-06T04:17:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.603+0000 7f95adffb700 1 -- 172.21.15.37:0/3282787996 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95a40230a0 con 0x7f95b01539c0 2023-10-06T04:17:25.605 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 msgr2=0x7f959c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 0x7f959c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001370 tx=0x7f95a8007ba0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 msgr2=0x7f95b0157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95a400c2a0 tx=0x7f95a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 shutdown_connections 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f95b0153d90 0x7f95b00b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95b00d02e0 0x7f95b0158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 --2- 172.21.15.37:0/3282787996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b01539c0 0x7f95b0157180 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 >> 172.21.15.37:0/3282787996 conn(0x7f95b006ed90 msgr2=0x7f95b00b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 shutdown_connections 2023-10-06T04:17:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.605+0000 7f95b69c1700 1 -- 172.21.15.37:0/3282787996 wait complete. 2023-10-06T04:17:25.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.740+0000 7f6551906700 1 Processor -- start 2023-10-06T04:17:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.740+0000 7f6551906700 1 -- start start 2023-10-06T04:17:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f6551906700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f6551906700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cf700 0x7f654c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f6551906700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0cdb20 con 0x7f654c0ce260 2023-10-06T04:17:25.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f6551906700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0b3090 con 0x7f654c0cf700 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f6551906700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0c5430 con 0x7f654c159dc0 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f654b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cf700 0x7f654c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f654b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f654c0cf700 0x7f654c0cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55676/0 (socket says 172.21.15.37:55676) 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f654b7fe700 1 -- 172.21.15.37:0/2678061399 learned_addr learned my addr 172.21.15.37:0/2678061399 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.741+0000 7f654a7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f654c0ce260 0x7f654c0ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54132/0 (socket says 172.21.15.37:54132) 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654affd700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654b7fe700 1 -- 172.21.15.37:0/2678061399 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 msgr2=0x7f654c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654b7fe700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654b7fe700 1 -- 172.21.15.37:0/2678061399 >> v1:172.21.15.37:6789/0 conn(0x7f654c0ce260 legacy=0x7f654c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654b7fe700 1 -- 172.21.15.37:0/2678061399 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0c6290 con 0x7f654c0cf700 2023-10-06T04:17:25.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654affd700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f654b7fe700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0cc6a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f653c0099b0 tx=0x7f653c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ef3b16da669d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f6549ffb700 1 -- 172.21.15.37:0/2678061399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00b860 con 0x7f654c0cf700 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f6549ffb700 1 -- 172.21.15.37:0/2678061399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c00b9c0 con 0x7f654c0cf700 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.742+0000 7f6549ffb700 1 -- 172.21.15.37:0/2678061399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00bd60 con 0x7f654c0cf700 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 -- 172.21.15.37:0/2678061399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 msgr2=0x7f654c0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0cc6a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f653c0099b0 tx=0x7f653c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 -- 172.21.15.37:0/2678061399 shutdown_connections 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0cc6a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 --2- 172.21.15.37:0/2678061399 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 -- 172.21.15.37:0/2678061399 >> 172.21.15.37:0/2678061399 conn(0x7f654c099a50 msgr2=0x7f654c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 -- 172.21.15.37:0/2678061399 shutdown_connections 2023-10-06T04:17:25.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.743+0000 7f6551906700 1 -- 172.21.15.37:0/2678061399 wait complete. 2023-10-06T04:17:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.744+0000 7f6551906700 1 Processor -- start 2023-10-06T04:17:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.744+0000 7f6551906700 1 -- start start 2023-10-06T04:17:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ce260 0x7f654c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c157b70 con 0x7f654c0cf700 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0c8120 con 0x7f654c0ce260 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6551906700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c157520 con 0x7f654c159dc0 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55690/0 (socket says 172.21.15.37:55690) 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 -- 172.21.15.37:0/1585413719 learned_addr learned my addr 172.21.15.37:0/1585413719 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654affd700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ce260 0x7f654c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654b7fe700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 -- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 msgr2=0x7f654c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 -- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ce260 msgr2=0x7f654c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ce260 0x7f654c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 -- 172.21.15.37:0/1585413719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0094f0 con 0x7f654c0cf700 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f654a7fc700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f6534007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.745+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534005a70 con 0x7f654c0cf700 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.746+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534005bd0 con 0x7f654c0cf700 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.746+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340070d0 con 0x7f654c0cf700 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.746+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c157800 con 0x7f654c0cf700 2023-10-06T04:17:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.746+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c0c8400 con 0x7f654c0cf700 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.746+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c157370 con 0x7f654c0cf700 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.747+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6534007440 con 0x7f654c0cf700 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.747+0000 7f6542ffd700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.747+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6534083aa0 con 0x7f654c0cf700 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.747+0000 7f654affd700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.748+0000 7f654affd700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6544007700 tx=0x7f6544009980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.752+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6534050bb0 con 0x7f654c0cf700 2023-10-06T04:17:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.945+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f654c04c3c0 con 0x7f654c0cf700 2023-10-06T04:17:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.946+0000 7f6542ffd700 1 -- 172.21.15.37:0/1585413719 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6534017070 con 0x7f654c0cf700 2023-10-06T04:17:25.948 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 msgr2=0x7f652c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6544007700 tx=0x7f6544009980 comp rx=0 tx=0).stop 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 msgr2=0x7f654c0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f6534007f30 comp rx=0 tx=0).stop 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 shutdown_connections 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f654c159dc0 0x7f654c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f652c066f30 0x7f652c0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f654c0ce260 0x7f654c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 --2- 172.21.15.37:0/1585413719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c0cf700 0x7f654c0c7740 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 >> 172.21.15.37:0/1585413719 conn(0x7f654c099a50 msgr2=0x7f654c0c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 shutdown_connections 2023-10-06T04:17:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:25.948+0000 7f6551906700 1 -- 172.21.15.37:0/1585413719 wait complete. 2023-10-06T04:17:25.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.082+0000 7ff005666700 1 Processor -- start 2023-10-06T04:17:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.083+0000 7ff005666700 1 -- start start 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7ff005666700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff000159dc0 0x7ff0000ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7ff005666700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff0000ce260 0x7ff0000ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7ff005666700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0000cdb20 con 0x7ff0000cf530 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7ff005666700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0000b3090 con 0x7ff000159dc0 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7ff005666700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0000cf990 con 0x7ff0000ce260 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff000159dc0 0x7ff0000ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7fefff7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0000cf530 0x7ff0000c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54148/0 (socket says 172.21.15.37:54148) 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff000159dc0 0x7ff0000ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55692/0 (socket says 172.21.15.37:55692) 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7fefff7fe700 1 -- 172.21.15.37:0/877835431 learned_addr learned my addr 172.21.15.37:0/877835431 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffe7fc700 1 --2- 172.21.15.37:0/877835431 >> v2:172.21.15.83:3300/0 conn(0x7ff0000ce260 0x7ff0000ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 -- 172.21.15.37:0/877835431 >> v2:172.21.15.83:3300/0 conn(0x7ff0000ce260 msgr2=0x7ff0000ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 --2- 172.21.15.37:0/877835431 >> v2:172.21.15.83:3300/0 conn(0x7ff0000ce260 0x7ff0000ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 -- 172.21.15.37:0/877835431 >> v1:172.21.15.37:6789/0 conn(0x7ff0000cf530 legacy=0x7ff0000c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 -- 172.21.15.37:0/877835431 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000c5430 con 0x7ff000159dc0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffdffb700 1 -- 172.21.15.37:0/877835431 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446262488 0 0) 0x7ff0000cdb20 con 0x7ff0000cf530 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffeffd700 1 --2- 172.21.15.37:0/877835431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff000159dc0 0x7ff0000ad140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0000888b0 tx=0x7feff8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21e7e15f7582632 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffdffb700 1 -- 172.21.15.37:0/877835431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff800e070 con 0x7ff000159dc0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffdffb700 1 -- 172.21.15.37:0/877835431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff800bc30 con 0x7ff000159dc0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.084+0000 7feffdffb700 1 -- 172.21.15.37:0/877835431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8012430 con 0x7ff000159dc0 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 -- 172.21.15.37:0/877835431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff000159dc0 msgr2=0x7ff0000ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 --2- 172.21.15.37:0/877835431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff000159dc0 0x7ff0000ad140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0000888b0 tx=0x7feff8009780 comp rx=0 tx=0).stop 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 -- 172.21.15.37:0/877835431 shutdown_connections 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 --2- 172.21.15.37:0/877835431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff000159dc0 0x7ff0000ad140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 --2- 172.21.15.37:0/877835431 >> v2:172.21.15.83:3300/0 conn(0x7ff0000ce260 0x7ff0000ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 -- 172.21.15.37:0/877835431 >> 172.21.15.37:0/877835431 conn(0x7ff000099a50 msgr2=0x7ff00006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 -- 172.21.15.37:0/877835431 shutdown_connections 2023-10-06T04:17:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.085+0000 7ff005666700 1 -- 172.21.15.37:0/877835431 wait complete. 2023-10-06T04:17:26.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.086+0000 7ff005666700 1 Processor -- start 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.086+0000 7ff005666700 1 -- start start 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 0x7ff0001572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff000159dc0 0x7ff0000c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff000157830 con 0x7ff0000cf530 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000c87b0 con 0x7ff000159dc0 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7ff005666700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000c8a90 con 0x7ff0000ce260 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7feffe7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7feffe7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55704/0 (socket says 172.21.15.37:55704) 2023-10-06T04:17:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7feffe7fc700 1 -- 172.21.15.37:0/876505959 learned_addr learned my addr 172.21.15.37:0/876505959 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7feffeffd700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 0x7ff0001572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7fefff7fe700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff000159dc0 0x7ff0000c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.087+0000 7feffe7fc700 1 -- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 msgr2=0x7ff0001572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffe7fc700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 0x7ff0001572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffe7fc700 1 -- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff000159dc0 msgr2=0x7ff0000c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffe7fc700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff000159dc0 0x7ff0000c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffe7fc700 1 -- 172.21.15.37:0/876505959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009a20 con 0x7ff0000cf530 2023-10-06T04:17:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffeffd700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 0x7ff0001572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feffe7fc700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006b00 tx=0x7fefe8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80125f0 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8012770 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8012b30 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0000c8d70 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.088+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0000c9330 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.089+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00004c3c0 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.089+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefe801e460 con 0x7ff0000cf530 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.089+0000 7feff6ffd700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.090+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fefe8084c90 con 0x7ff0000cf530 2023-10-06T04:17:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.090+0000 7feffeffd700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.090+0000 7feffeffd700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 0x7fefe00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0000888b0 tx=0x7feff8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.094+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefe8051da0 con 0x7ff0000cf530 2023-10-06T04:17:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.284+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff000067fd0 con 0x7ff0000cf530 2023-10-06T04:17:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.285+0000 7feff6ffd700 1 -- 172.21.15.37:0/876505959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefe80553c0 con 0x7ff0000cf530 2023-10-06T04:17:26.286 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 msgr2=0x7fefe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 0x7fefe00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0000888b0 tx=0x7feff8019000 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 msgr2=0x7ff00009b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006b00 tx=0x7fefe8008040 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 shutdown_connections 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fefe0066f30 0x7fefe00693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff000159dc0 0x7ff0000c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff0000ce260 0x7ff0001572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 --2- 172.21.15.37:0/876505959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0000cf530 0x7ff00009b920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 >> 172.21.15.37:0/876505959 conn(0x7ff000099a50 msgr2=0x7ff0000cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 shutdown_connections 2023-10-06T04:17:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.287+0000 7ff005666700 1 -- 172.21.15.37:0/876505959 wait complete. 2023-10-06T04:17:26.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.421+0000 7fcf3e64f700 1 Processor -- start 2023-10-06T04:17:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.421+0000 7fcf3e64f700 1 -- start start 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3e64f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf380cd0e0 0x7fcf380cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3e64f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 0x7fcf380ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3e64f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf380b0ab0 con 0x7fcf380cd4b0 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3e64f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf380cdd80 con 0x7fcf380cd0e0 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3e64f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380cb050 con 0x7fcf380cb4b0 2023-10-06T04:17:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf380cd0e0 0x7fcf380cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf380cd0e0 0x7fcf380cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49634/0 (socket says 172.21.15.37:49634) 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 -- 172.21.15.37:0/1336408478 learned_addr learned my addr 172.21.15.37:0/1336408478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3de4e700 1 --1- 172.21.15.37:0/1336408478 >> v1:172.21.15.37:6789/0 conn(0x7fcf380cd4b0 0x7fcf380b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53902/0 (socket says 172.21.15.37:53902) 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 0x7fcf380ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 -- 172.21.15.37:0/1336408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 msgr2=0x7fcf380ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 0x7fcf380ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 -- 172.21.15.37:0/1336408478 >> v1:172.21.15.37:6789/0 conn(0x7fcf380cd4b0 legacy=0x7fcf380b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf37fff700 1 -- 172.21.15.37:0/1336408478 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692974965 0 0) 0x7fcf380b0ab0 con 0x7fcf380cd4b0 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3d64d700 1 -- 172.21.15.37:0/1336408478 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380b0d90 con 0x7fcf380cd0e0 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.422+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 0x7fcf380ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3d64d700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cd0e0 0x7fcf380cab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcf300099b0 tx=0x7fcf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fde54805b869b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf37fff700 1 -- 172.21.15.37:0/1336408478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000b860 con 0x7fcf380cd0e0 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf37fff700 1 -- 172.21.15.37:0/1336408478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000b9c0 con 0x7fcf380cd0e0 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf37fff700 1 -- 172.21.15.37:0/1336408478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000bd60 con 0x7fcf380cd0e0 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 -- 172.21.15.37:0/1336408478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cd0e0 msgr2=0x7fcf380cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cd0e0 0x7fcf380cab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcf300099b0 tx=0x7fcf30009250 comp rx=0 tx=0).stop 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 -- 172.21.15.37:0/1336408478 shutdown_connections 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cd0e0 0x7fcf380cab10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/1336408478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cb4b0 0x7fcf380ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 -- 172.21.15.37:0/1336408478 >> 172.21.15.37:0/1336408478 conn(0x7fcf380686c0 msgr2=0x7fcf38068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 -- 172.21.15.37:0/1336408478 shutdown_connections 2023-10-06T04:17:26.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.423+0000 7fcf3e64f700 1 -- 172.21.15.37:0/1336408478 wait complete. 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.424+0000 7fcf3e64f700 1 Processor -- start 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.424+0000 7fcf3e64f700 1 -- start start 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 0x7fcf380c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 0x7fcf380c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380c8a20 con 0x7fcf380cb4b0 2023-10-06T04:17:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38154e10 con 0x7fcf380cd0e0 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3e64f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf381544e0 con 0x7fcf380cd4b0 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3d64d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3d64d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49638/0 (socket says 172.21.15.37:49638) 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.425+0000 7fcf3d64d700 1 -- 172.21.15.37:0/101599077 learned_addr learned my addr 172.21.15.37:0/101599077 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3de4e700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 0x7fcf380c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 0x7fcf380c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 -- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 msgr2=0x7fcf380c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 0x7fcf380c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 -- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 msgr2=0x7fcf380c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 0x7fcf380c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 -- 172.21.15.37:0/101599077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300094f0 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3de4e700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 0x7fcf380c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 0x7fcf380c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3d64d700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009290 tx=0x7fcf30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30026480 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3001f070 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf381547c0 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30026830 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.426+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3814ec40 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.427+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf38154620 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.427+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf3001a430 con 0x7fcf380cb4b0 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.428+0000 7fcf357fa700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.428+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf30021070 con 0x7fcf380cb4b0 2023-10-06T04:17:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.428+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.428+0000 7fcf3ce4c700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 0x7fcf240693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c006f00 tx=0x7fcf2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.432+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf38154620 con 0x7fcf380cb4b0 2023-10-06T04:17:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.623+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf38154620 con 0x7fcf380cb4b0 2023-10-06T04:17:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.623+0000 7fcf357fa700 1 -- 172.21.15.37:0/101599077 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf38154620 con 0x7fcf380cb4b0 2023-10-06T04:17:26.625 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 msgr2=0x7fcf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 0x7fcf240693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c006f00 tx=0x7fcf2c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 msgr2=0x7fcf3814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009290 tx=0x7fcf30017000 comp rx=0 tx=0).stop 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 shutdown_connections 2023-10-06T04:17:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf380cd4b0 0x7fcf380c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf380cb4b0 0x7fcf3814e700 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcf24066f30 0x7fcf240693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 --2- 172.21.15.37:0/101599077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf380cd0e0 0x7fcf380c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 >> 172.21.15.37:0/101599077 conn(0x7fcf380686c0 msgr2=0x7fcf38151e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 shutdown_connections 2023-10-06T04:17:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.625+0000 7fcf3e64f700 1 -- 172.21.15.37:0/101599077 wait complete. 2023-10-06T04:17:26.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.757+0000 7f0787534700 1 Processor -- start 2023-10-06T04:17:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.757+0000 7f0787534700 1 -- start start 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0787534700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078015dc70 0x7f07800ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0787534700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07800b6200 0x7f07800ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0787534700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07800ae9f0 con 0x7f07800b5e30 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0787534700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800adb70 con 0x7f078015dc70 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0787534700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07800adde0 con 0x7f07800b6200 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078015dc70 0x7f07800ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078015dc70 0x7f07800ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49648/0 (socket says 172.21.15.37:49648) 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 -- 172.21.15.37:0/1807308383 learned_addr learned my addr 172.21.15.37:0/1807308383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:26.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0785ad1700 1 --2- 172.21.15.37:0/1807308383 >> v2:172.21.15.83:3300/0 conn(0x7f07800b6200 0x7f07800ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 -- 172.21.15.37:0/1807308383 >> v2:172.21.15.83:3300/0 conn(0x7f07800b6200 msgr2=0x7f07800ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 --2- 172.21.15.37:0/1807308383 >> v2:172.21.15.83:3300/0 conn(0x7f07800b6200 0x7f07800ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 -- 172.21.15.37:0/1807308383 >> v1:172.21.15.83:6789/0 conn(0x7f07800b5e30 legacy=0x7f078015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 -- 172.21.15.37:0/1807308383 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800ae0c0 con 0x7f078015dc70 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f0784acf700 1 --2- 172.21.15.37:0/1807308383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078015dc70 0x7f07800ad0f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f078015af50 tx=0x7f0774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f199f2a19dd3087 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.758+0000 7f077ffff700 1 -- 172.21.15.37:0/1807308383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400b820 con 0x7f078015dc70 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f077ffff700 1 -- 172.21.15.37:0/1807308383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400b980 con 0x7f078015dc70 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f077ffff700 1 -- 172.21.15.37:0/1807308383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400bd20 con 0x7f078015dc70 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 -- 172.21.15.37:0/1807308383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078015dc70 msgr2=0x7f07800ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 --2- 172.21.15.37:0/1807308383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078015dc70 0x7f07800ad0f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f078015af50 tx=0x7f0774009250 comp rx=0 tx=0).stop 2023-10-06T04:17:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 -- 172.21.15.37:0/1807308383 shutdown_connections 2023-10-06T04:17:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 --2- 172.21.15.37:0/1807308383 >> v2:172.21.15.83:3300/0 conn(0x7f07800b6200 0x7f07800ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 --2- 172.21.15.37:0/1807308383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078015dc70 0x7f07800ad0f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 -- 172.21.15.37:0/1807308383 >> 172.21.15.37:0/1807308383 conn(0x7f0780099a10 msgr2=0x7f078006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 -- 172.21.15.37:0/1807308383 shutdown_connections 2023-10-06T04:17:26.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.759+0000 7f0787534700 1 -- 172.21.15.37:0/1807308383 wait complete. 2023-10-06T04:17:26.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.760+0000 7f0787534700 1 Processor -- start 2023-10-06T04:17:26.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.760+0000 7f0787534700 1 -- start start 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 0x7f0780156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f078015dc70 0x7f07800af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780156ac0 con 0x7f07800b6200 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078009e1a0 con 0x7f078015dc70 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0787534700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078009d590 con 0x7f07800b5e30 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49662/0 (socket says 172.21.15.37:49662) 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 -- 172.21.15.37:0/2763584239 learned_addr learned my addr 172.21.15.37:0/2763584239 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0785ad1700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f078015dc70 0x7f07800af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f07852d0700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 0x7f0780156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 -- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 msgr2=0x7f0780156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 0x7f0780156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 -- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f078015dc70 msgr2=0x7f07800af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f078015dc70 0x7f07800af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f0784acf700 1 -- 172.21.15.37:0/2763584239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094f0 con 0x7f07800b6200 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.761+0000 7f07852d0700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 0x7f0780156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f0784acf700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07740030c0 tx=0x7f0774016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011db0 con 0x7f07800b6200 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774020070 con 0x7f07800b6200 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078009d870 con 0x7f07800b6200 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077401b6a0 con 0x7f07800b6200 2023-10-06T04:17:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.762+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078009de30 con 0x7f07800b6200 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.763+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07800b2f90 con 0x7f07800b6200 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.763+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0774022030 con 0x7f07800b6200 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.764+0000 7f077d7fa700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.764+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07740864a0 con 0x7f07800b6200 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.764+0000 7f07852d0700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.764+0000 7f07852d0700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0778007fd0 tx=0x7f0778009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.768+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07740535b0 con 0x7f07800b6200 2023-10-06T04:17:26.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.966+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07800b2f90 con 0x7f07800b6200 2023-10-06T04:17:26.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.967+0000 7f077d7fa700 1 -- 172.21.15.37:0/2763584239 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f0774056bd0 con 0x7f07800b6200 2023-10-06T04:17:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:26.969 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 msgr2=0x7f076c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 0x7f076c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0778007fd0 tx=0x7f0778009040 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 msgr2=0x7f078009cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07740030c0 tx=0x7f0774016000 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 shutdown_connections 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f076c066f30 0x7f076c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f078015dc70 0x7f07800af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07800b5e30 0x7f0780156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 --2- 172.21.15.37:0/2763584239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b6200 0x7f078009cc30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 >> 172.21.15.37:0/2763584239 conn(0x7f0780099a10 msgr2=0x7f07800b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 shutdown_connections 2023-10-06T04:17:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:26.969+0000 7f0787534700 1 -- 172.21.15.37:0/2763584239 wait complete. 2023-10-06T04:17:26.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:26.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.103+0000 7f37baebb700 1 Processor -- start 2023-10-06T04:17:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 -- start start 2023-10-06T04:17:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f37b406a040 0x7f37b415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b406c110 0x7f37b40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b415dd80 con 0x7f37b406bd40 2023-10-06T04:17:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b415db70 con 0x7f37b406a040 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37baebb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4068aa0 con 0x7f37b406c110 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37b8c57700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37b406bd40 0x7f37b40b1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53912/0 (socket says 172.21.15.37:53912) 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.104+0000 7f37b8c57700 1 -- 172.21.15.37:0/2723665560 learned_addr learned my addr 172.21.15.37:0/2723665560 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599155313 0 0) 0x7f37b415dd80 con 0x7f37b406bd40 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003570 con 0x7f37b406bd40 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b3fff700 1 --2- 172.21.15.37:0/2723665560 >> v2:172.21.15.83:3300/0 conn(0x7f37b406a040 0x7f37b415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b9458700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b406c110 0x7f37b40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153569161 0 0) 0x7f37a0003570 con 0x7f37b406bd40 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b406c110 msgr2=0x7f37b40692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b406c110 0x7f37b40692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 >> v2:172.21.15.83:3300/0 conn(0x7f37b406a040 msgr2=0x7f37b415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 --2- 172.21.15.37:0/2723665560 >> v2:172.21.15.83:3300/0 conn(0x7f37b406a040 0x7f37b415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b415e060 con 0x7f37b406bd40 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f37ac001470 con 0x7f37b406bd40 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 >> v1:172.21.15.37:6789/0 conn(0x7f37b406bd40 legacy=0x7f37b40b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a0003a60 0x7f37a0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0004810 0x7f37a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37a00051c0 0x7f37a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b415db70 con 0x7f37a0003a60 2023-10-06T04:17:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4068aa0 con 0x7f37a0004810 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000c100 con 0x7f37a00051c0 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b3fff700 1 --2- 172.21.15.37:0/2723665560 >> v2:172.21.15.83:3300/0 conn(0x7f37b406a040 0x7f37b415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b9458700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b406c110 0x7f37b40692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b8c57700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a0003a60 0x7f37a0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b3fff700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0004810 0x7f37a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b9458700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37a00051c0 0x7f37a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b8c57700 1 -- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37a00051c0 msgr2=0x7f37a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.105+0000 7f37b8c57700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37a00051c0 0x7f37a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b8c57700 1 -- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0004810 msgr2=0x7f37a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b8c57700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0004810 0x7f37a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b8c57700 1 -- 172.21.15.37:0/2723665560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0003570 con 0x7f37a0003a60 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b9458700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37a00051c0 0x7f37a000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b8c57700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a0003a60 0x7f37a0003e90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c3c0 tx=0x7f37ac001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225b2c6f16184ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00cc90 con 0x7f37a0003a60 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00ce30 con 0x7f37a0003a60 2023-10-06T04:17:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b37fe700 1 -- 172.21.15.37:0/2723665560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac005b70 con 0x7f37a0003a60 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 -- 172.21.15.37:0/2723665560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a0003a60 msgr2=0x7f37a0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 --2- 172.21.15.37:0/2723665560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a0003a60 0x7f37a0003e90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c3c0 tx=0x7f37ac001e90 comp rx=0 tx=0).stop 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37b9458700 1 -- 172.21.15.37:0/2723665560 reap_dead start 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 -- 172.21.15.37:0/2723665560 shutdown_connections 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 -- 172.21.15.37:0/2723665560 >> 172.21.15.37:0/2723665560 conn(0x7f37b40ce680 msgr2=0x7f37b40cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 -- 172.21.15.37:0/2723665560 shutdown_connections 2023-10-06T04:17:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.106+0000 7f37baebb700 1 -- 172.21.15.37:0/2723665560 wait complete. 2023-10-06T04:17:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.107+0000 7f37baebb700 1 Processor -- start 2023-10-06T04:17:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 -- start start 2023-10-06T04:17:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0003a60 0x7f37b415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b40c2fc0 0x7f37b40c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c25f0 con 0x7f37b415c500 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c1fe0 con 0x7f37a0003a60 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.108+0000 7f37baebb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c8e90 con 0x7f37b40c2fc0 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49692/0 (socket says 172.21.15.37:49692) 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 -- 172.21.15.37:0/1098637672 learned_addr learned my addr 172.21.15.37:0/1098637672 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b8c57700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0003a60 0x7f37b415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b9458700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b40c2fc0 0x7f37b40c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 -- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b40c2fc0 msgr2=0x7f37b40c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b40c2fc0 0x7f37b40c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 -- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0003a60 msgr2=0x7f37b415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0003a60 0x7f37b415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 -- 172.21.15.37:0/1098637672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40c9170 con 0x7f37b415c500 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b3fff700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37a40025b0 tx=0x7f37a4009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4014410 con 0x7f37b415c500 2023-10-06T04:17:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400f050 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b40c2280 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40147c0 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.109+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b40c3ca0 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.110+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b404c3c0 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.111+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37a4003040 con 0x7f37b415c500 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.111+0000 7f37b0ff9700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 0x7f37940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.111+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37a4084cd0 con 0x7f37b415c500 2023-10-06T04:17:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.111+0000 7f37b8c57700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 0x7f37940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.112+0000 7f37b8c57700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 0x7f37940693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c3c0 tx=0x7f37ac015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.115+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37a4051ea0 con 0x7f37b415c500 2023-10-06T04:17:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.305+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37b40c5e80 con 0x7f37b415c500 2023-10-06T04:17:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.305+0000 7f37b0ff9700 1 -- 172.21.15.37:0/1098637672 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37a40554c0 con 0x7f37b415c500 2023-10-06T04:17:27.307 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 msgr2=0x7f37940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 0x7f37940693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c3c0 tx=0x7f37ac015000 comp rx=0 tx=0).stop 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 msgr2=0x7f37b40c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37a40025b0 tx=0x7f37a4009b40 comp rx=0 tx=0).stop 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 shutdown_connections 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f37b40c2fc0 0x7f37b40c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3794066f30 0x7f37940693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f37a0003a60 0x7f37b415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 --2- 172.21.15.37:0/1098637672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b415c500 0x7f37b40c2a80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 >> 172.21.15.37:0/1098637672 conn(0x7f37b40ce680 msgr2=0x7f37b40cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 shutdown_connections 2023-10-06T04:17:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.307+0000 7f37baebb700 1 -- 172.21.15.37:0/1098637672 wait complete. 2023-10-06T04:17:27.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:27.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.440+0000 7fb199dd2700 1 Processor -- start 2023-10-06T04:17:27.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.440+0000 7fb199dd2700 1 -- start start 2023-10-06T04:17:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb199dd2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1940ce260 0x7fb1940cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb199dd2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940cdb20 con 0x7fb194159dc0 2023-10-06T04:17:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb199dd2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1940c5430 con 0x7fb1940ceff0 2023-10-06T04:17:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb199dd2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940b3090 con 0x7fb1940ce260 2023-10-06T04:17:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb192ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1940ce260 0x7fb1940cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb1937fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb194159dc0 0x7fb1940ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53922/0 (socket says 172.21.15.37:53922) 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb1937fe700 1 -- 172.21.15.37:0/3584136155 learned_addr learned my addr 172.21.15.37:0/3584136155 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb192ffd700 1 -- 172.21.15.37:0/3584136155 >> v1:172.21.15.83:6789/0 conn(0x7fb1940ceff0 legacy=0x7fb1940c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb192ffd700 1 -- 172.21.15.37:0/3584136155 >> v1:172.21.15.37:6789/0 conn(0x7fb194159dc0 legacy=0x7fb1940ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb1927fc700 1 -- 172.21.15.37:0/3584136155 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250290423 0 0) 0x7fb1940cdb20 con 0x7fb194159dc0 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.441+0000 7fb192ffd700 1 -- 172.21.15.37:0/3584136155 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940c6290 con 0x7fb1940ce260 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb192ffd700 1 --2- 172.21.15.37:0/3584136155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb1940cc6a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098e0 tx=0x7fb1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da1e6a929d62c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb1927fc700 1 -- 172.21.15.37:0/3584136155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188009e80 con 0x7fb1940ce260 2023-10-06T04:17:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb1927fc700 1 -- 172.21.15.37:0/3584136155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18800b860 con 0x7fb1940ce260 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb1927fc700 1 -- 172.21.15.37:0/3584136155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800bbe0 con 0x7fb1940ce260 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 -- 172.21.15.37:0/3584136155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 msgr2=0x7fb1940cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 --2- 172.21.15.37:0/3584136155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb1940cc6a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098e0 tx=0x7fb1880091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 -- 172.21.15.37:0/3584136155 shutdown_connections 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 --2- 172.21.15.37:0/3584136155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb1940cc6a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 -- 172.21.15.37:0/3584136155 >> 172.21.15.37:0/3584136155 conn(0x7fb194099a50 msgr2=0x7fb19406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 -- 172.21.15.37:0/3584136155 shutdown_connections 2023-10-06T04:17:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.442+0000 7fb199dd2700 1 -- 172.21.15.37:0/3584136155 wait complete. 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 Processor -- start 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 -- start start 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1940ceff0 0x7fb1940d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb194159dc0 0x7fb19416ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19415e340 con 0x7fb1940ce260 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19416a350 con 0x7fb1940ceff0 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb199dd2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19416a630 con 0x7fb194159dc0 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49706/0 (socket says 172.21.15.37:49706) 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.444+0000 7fb1937fe700 1 -- 172.21.15.37:0/1885456308 learned_addr learned my addr 172.21.15.37:0/1885456308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb192ffd700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1940ceff0 0x7fb1940d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb193fff700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb194159dc0 0x7fb19416ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 -- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb194159dc0 msgr2=0x7fb19416ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb194159dc0 0x7fb19416ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 -- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1940ceff0 msgr2=0x7fb1940d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1940ceff0 0x7fb1940d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 -- 172.21.15.37:0/1885456308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009420 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb1937fe700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c810 tx=0x7fb184007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840072e0 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184007460 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19416a910 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840057f0 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.445+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1940d0e20 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.446+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19404c3c0 con 0x7fb1940ce260 2023-10-06T04:17:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.447+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb184005c20 con 0x7fb1940ce260 2023-10-06T04:17:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.447+0000 7fb17b7fe700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 0x7fb1800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.447+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb184083aa0 con 0x7fb1940ce260 2023-10-06T04:17:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.447+0000 7fb192ffd700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 0x7fb1800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.448+0000 7fb192ffd700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 0x7fb1800693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1940ce6c0 tx=0x7fb188017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.451+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb184050c60 con 0x7fb1940ce260 2023-10-06T04:17:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.643+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb194067fd0 con 0x7fb1940ce260 2023-10-06T04:17:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.643+0000 7fb17b7fe700 1 -- 172.21.15.37:0/1885456308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb184017020 con 0x7fb1940ce260 2023-10-06T04:17:27.645 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.645+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 msgr2=0x7fb1800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.645+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 0x7fb1800693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1940ce6c0 tx=0x7fb188017000 comp rx=0 tx=0).stop 2023-10-06T04:17:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.645+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 msgr2=0x7fb194169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.645+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c810 tx=0x7fb184007c00 comp rx=0 tx=0).stop 2023-10-06T04:17:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 shutdown_connections 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb194159dc0 0x7fb19416ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1940ce260 0x7fb194169d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb180066f30 0x7fb1800693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 --2- 172.21.15.37:0/1885456308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1940ceff0 0x7fb1940d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 >> 172.21.15.37:0/1885456308 conn(0x7fb194099a50 msgr2=0x7fb194063860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 shutdown_connections 2023-10-06T04:17:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.646+0000 7fb199dd2700 1 -- 172.21.15.37:0/1885456308 wait complete. 2023-10-06T04:17:27.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 Processor -- start 2023-10-06T04:17:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 -- start start 2023-10-06T04:17:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f10301539c0 0x7f1030159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10300b51a0 con 0x7f10300d02e0 2023-10-06T04:17:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10300b5ff0 con 0x7f1030153d90 2023-10-06T04:17:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.782+0000 7f1034d8e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10300b53e0 con 0x7f10301539c0 2023-10-06T04:17:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10300d02e0 0x7f1030163500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53936/0 (socket says 172.21.15.37:53936) 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102ffff700 1 -- 172.21.15.37:0/1854176264 learned_addr learned my addr 172.21.15.37:0/1854176264 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102f7fe700 1 --2- 172.21.15.37:0/1854176264 >> v2:172.21.15.83:3300/0 conn(0x7f10301539c0 0x7f1030159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244439742 0 0) 0x7f1028001490 con 0x7f10300d02e0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f101c003570 con 0x7f10300d02e0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309512576 0 0) 0x7f101c003570 con 0x7f10300d02e0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 >> v2:172.21.15.83:3300/0 conn(0x7f10301539c0 msgr2=0x7f1030159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 --2- 172.21.15.37:0/1854176264 >> v2:172.21.15.83:3300/0 conn(0x7f10301539c0 0x7f1030159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 >> v1:172.21.15.83:6789/0 conn(0x7f1030153d90 legacy=0x7f10300b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300b56c0 con 0x7f10300d02e0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f1028001980 con 0x7f10300d02e0 2023-10-06T04:17:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 >> v1:172.21.15.37:6789/0 conn(0x7f10300d02e0 legacy=0x7f1030163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f101c003a60 0x7f101c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f101c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101c0051c0 0x7f101c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10300b53e0 con 0x7f101c004810 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c00c0d0 con 0x7f101c003a60 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c00c290 con 0x7f101c0051c0 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102effd700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f101c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102f7fe700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f101c003a60 0x7f101c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.783+0000 7f102ffff700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101c0051c0 0x7f101c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 -- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101c0051c0 msgr2=0x7f101c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f101c0051c0 0x7f101c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 -- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f101c003a60 msgr2=0x7f101c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f101c003a60 0x7f101c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 -- 172.21.15.37:0/1854176264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c003570 con 0x7f101c004810 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102ffff700 1 -- 172.21.15.37:0/1854176264 reap_dead start 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102effd700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f101c004c80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1018001880 tx=0x7f1018007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c690cb05808667 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012420 con 0x7f101c004810 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018012580 con 0x7f101c004810 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f102e7fc700 1 -- 172.21.15.37:0/1854176264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012920 con 0x7f101c004810 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f1034d8e700 1 -- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 msgr2=0x7f101c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.784+0000 7f1034d8e700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f101c004c80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1018001880 tx=0x7f1018007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.785+0000 7f1034d8e700 1 -- 172.21.15.37:0/1854176264 shutdown_connections 2023-10-06T04:17:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.785+0000 7f1034d8e700 1 --2- 172.21.15.37:0/1854176264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f101c004c80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.785+0000 7f1034d8e700 1 -- 172.21.15.37:0/1854176264 >> 172.21.15.37:0/1854176264 conn(0x7f103006ed90 msgr2=0x7f103006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.785+0000 7f1034d8e700 1 -- 172.21.15.37:0/1854176264 shutdown_connections 2023-10-06T04:17:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.785+0000 7f1034d8e700 1 -- 172.21.15.37:0/1854176264 wait complete. 2023-10-06T04:17:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.786+0000 7f1034d8e700 1 Processor -- start 2023-10-06T04:17:27.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.786+0000 7f1034d8e700 1 -- start start 2023-10-06T04:17:27.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 0x7f103016a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 0x7f10300b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10301596a0 con 0x7f101c004810 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103016ab80 con 0x7f1030156be0 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300c56f0 con 0x7f103016da90 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49728/0 (socket says 172.21.15.37:49728) 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 -- 172.21.15.37:0/213217270 learned_addr learned my addr 172.21.15.37:0/213217270 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102effd700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 0x7f103016a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102ffff700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 0x7f10300b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 -- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 msgr2=0x7f10300b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 0x7f10300b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 -- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 msgr2=0x7f103016a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 0x7f103016a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 -- 172.21.15.37:0/213217270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300c5410 con 0x7f101c004810 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102ffff700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 0x7f10300b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102effd700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 0x7f103016a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f102f7fe700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1020011d40 tx=0x7f10200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000fa60 con 0x7f101c004810 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000fbc0 con 0x7f101c004810 2023-10-06T04:17:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103016d290 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020014440 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.787+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103016df30 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.788+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103016d730 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.789+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1020014a80 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.789+0000 7f10277fe700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 0x7f10100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.789+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1020018030 con 0x7f101c004810 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.789+0000 7f102effd700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 0x7f10100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.790+0000 7f102effd700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 0x7f10100693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f103016d150 tx=0x7f1018015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.794+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10200524b0 con 0x7f101c004810 2023-10-06T04:17:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.986+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f103016d8e0 con 0x7f101c004810 2023-10-06T04:17:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.987+0000 7f10277fe700 1 -- 172.21.15.37:0/213217270 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1020055ad0 con 0x7f101c004810 2023-10-06T04:17:27.988 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 msgr2=0x7f10100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 0x7f10100693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f103016d150 tx=0x7f1018015000 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 msgr2=0x7f1030158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1020011d40 tx=0x7f10200091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 shutdown_connections 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f103016da90 0x7f10300b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101c004810 0x7f1030158860 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1010066f30 0x7f10100693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 --2- 172.21.15.37:0/213217270 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1030156be0 0x7f103016a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 >> 172.21.15.37:0/213217270 conn(0x7f103006ed90 msgr2=0x7f1030152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:27.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 shutdown_connections 2023-10-06T04:17:27.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:27.989+0000 7f1034d8e700 1 -- 172.21.15.37:0/213217270 wait complete. 2023-10-06T04:17:28.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.123+0000 7f1657537700 1 Processor -- start 2023-10-06T04:17:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.123+0000 7f1657537700 1 -- start start 2023-10-06T04:17:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1657537700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f16500d09f0 0x7f1650159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1657537700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16500b51a0 con 0x7f16501539c0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1657537700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16500b5ff0 con 0x7f1650153d90 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1657537700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500b53e0 con 0x7f16500d09f0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1656535700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16501539c0 0x7f16500b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53942/0 (socket says 172.21.15.37:53942) 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1656535700 1 -- 172.21.15.37:0/1674909895 learned_addr learned my addr 172.21.15.37:0/1674909895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491131513 0 0) 0x7f164c001110 con 0x7f16501539c0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f163c003570 con 0x7f16501539c0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1656d36700 1 --2- 172.21.15.37:0/1674909895 >> v2:172.21.15.83:3300/0 conn(0x7f16500d09f0 0x7f1650159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 960647643 0 0) 0x7f163c003570 con 0x7f16501539c0 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 >> v2:172.21.15.83:3300/0 conn(0x7f16500d09f0 msgr2=0x7f1650159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 --2- 172.21.15.37:0/1674909895 >> v2:172.21.15.83:3300/0 conn(0x7f16500d09f0 0x7f1650159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.124+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 >> v1:172.21.15.83:6789/0 conn(0x7f1650153d90 legacy=0x7f16500d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500b56c0 con 0x7f16501539c0 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f164c001600 con 0x7f16501539c0 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 >> v1:172.21.15.37:6789/0 conn(0x7f16501539c0 legacy=0x7f16500b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c003a60 0x7f163c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163c004810 0x7f163c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 0x7f163c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500b53e0 con 0x7f163c0051c0 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c00c0d0 con 0x7f163c004810 2023-10-06T04:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c00c290 con 0x7f163c003a60 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 0x7f163c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655d34700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163c004810 0x7f163c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656535700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c003a60 0x7f163c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 -- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c003a60 msgr2=0x7f163c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c003a60 0x7f163c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 -- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163c004810 msgr2=0x7f163c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163c004810 0x7f163c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 -- 172.21.15.37:0/1674909895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c003570 con 0x7f163c0051c0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 -- 172.21.15.37:0/1674909895 reap_dead start 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1656d36700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 0x7f163c00ba60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16500d12b0 tx=0x7f164800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a33950ff830a327 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800ea60 con 0x7f163c0051c0 2023-10-06T04:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800f040 con 0x7f163c0051c0 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.125+0000 7f1655533700 1 -- 172.21.15.37:0/1674909895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800ee10 con 0x7f163c0051c0 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 -- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 msgr2=0x7f163c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 0x7f163c00ba60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16500d12b0 tx=0x7f164800b040 comp rx=0 tx=0).stop 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 -- 172.21.15.37:0/1674909895 shutdown_connections 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 --2- 172.21.15.37:0/1674909895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c0051c0 0x7f163c00ba60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 -- 172.21.15.37:0/1674909895 >> 172.21.15.37:0/1674909895 conn(0x7f165006ed90 msgr2=0x7f165006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 -- 172.21.15.37:0/1674909895 shutdown_connections 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.126+0000 7f1657537700 1 -- 172.21.15.37:0/1674909895 wait complete. 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.127+0000 7f1657537700 1 Processor -- start 2023-10-06T04:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.127+0000 7f1657537700 1 -- start start 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c0051c0 0x7f16500a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16500ad330 0x7f1650151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500aa740 con 0x7f165016dac0 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a9b60 con 0x7f16500ad330 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1657537700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a9e40 con 0x7f163c0051c0 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49734/0 (socket says 172.21.15.37:49734) 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 -- 172.21.15.37:0/2225340853 learned_addr learned my addr 172.21.15.37:0/2225340853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1656535700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c0051c0 0x7f16500a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1656d36700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16500ad330 0x7f1650151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 -- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c0051c0 msgr2=0x7f16500a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c0051c0 0x7f16500a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 -- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16500ad330 msgr2=0x7f1650151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16500ad330 0x7f1650151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 -- 172.21.15.37:0/2225340853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500aa120 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.128+0000 7f1655d34700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1640002950 tx=0x7f1640007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400032e0 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640006820 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16500aa990 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640006bc0 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650159010 con 0x7f165016dac0 2023-10-06T04:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.129+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650159230 con 0x7f165016dac0 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.130+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1640007030 con 0x7f165016dac0 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.130+0000 7f16467fc700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.130+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16400845d0 con 0x7f165016dac0 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.130+0000 7f1656535700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.131+0000 7f1656535700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f164c007b60 tx=0x7f164c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.134+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16400516e0 con 0x7f165016dac0 2023-10-06T04:17:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.325+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f165004c3c0 con 0x7f165016dac0 2023-10-06T04:17:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.326+0000 7f16467fc700 1 -- 172.21.15.37:0/2225340853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1640054d00 con 0x7f165016dac0 2023-10-06T04:17:28.327 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 msgr2=0x7f16340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 0x7f16340693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f164c007b60 tx=0x7f164c007a50 comp rx=0 tx=0).stop 2023-10-06T04:17:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 msgr2=0x7f1650158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1640002950 tx=0x7f1640007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 shutdown_connections 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1634066f30 0x7f16340693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16500ad330 0x7f1650151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163c0051c0 0x7f16500a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 --2- 172.21.15.37:0/2225340853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165016dac0 0x7f1650158ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.327+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 >> 172.21.15.37:0/2225340853 conn(0x7f165006ed90 msgr2=0x7f16500b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.328+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 shutdown_connections 2023-10-06T04:17:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.328+0000 7f1657537700 1 -- 172.21.15.37:0/2225340853 wait complete. 2023-10-06T04:17:28.417 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-06T04:17:28.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T04:17:28.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.537+0000 7f71dd2a0700 1 Processor -- start 2023-10-06T04:17:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.537+0000 7f71dd2a0700 1 -- start start 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71dd2a0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 0x7f71d815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71dd2a0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 0x7f71d815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71dd2a0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d80ae9f0 con 0x7f71d80b6200 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71dd2a0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80adde0 con 0x7f71d80ad800 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71dd2a0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80ae0c0 con 0x7f71d80b5e30 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d6ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 0x7f71d815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d67fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f71d80b6200 0x7f71d80ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:39878/0 (socket says 172.21.15.37:39878) 2023-10-06T04:17:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d77fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 0x7f71d815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d67fc700 1 -- 172.21.15.37:0/2908632801 learned_addr learned my addr 172.21.15.37:0/2908632801 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d5ffb700 1 -- 172.21.15.37:0/2908632801 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707336811 0 0) 0x7f71d80ae9f0 con 0x7f71d80b6200 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d6ffd700 1 -- 172.21.15.37:0/2908632801 >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 msgr2=0x7f71d815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d6ffd700 1 --2- 172.21.15.37:0/2908632801 >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 0x7f71d815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d6ffd700 1 -- 172.21.15.37:0/2908632801 >> v1:172.21.15.83:6789/0 conn(0x7f71d80b6200 legacy=0x7f71d80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d6ffd700 1 -- 172.21.15.37:0/2908632801 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80ae3a0 con 0x7f71d80b5e30 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.538+0000 7f71d77fe700 1 --2- 172.21.15.37:0/2908632801 >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 0x7f71d815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71d6ffd700 1 --2- 172.21.15.37:0/2908632801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 0x7f71d815d560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71c80098e0 tx=0x7f71c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bfd901f580c25f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71d5ffb700 1 -- 172.21.15.37:0/2908632801 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800b640 con 0x7f71d80b5e30 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71d5ffb700 1 -- 172.21.15.37:0/2908632801 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800b7a0 con 0x7f71d80b5e30 2023-10-06T04:17:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71d5ffb700 1 -- 172.21.15.37:0/2908632801 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800bb40 con 0x7f71d80b5e30 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 -- 172.21.15.37:0/2908632801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 msgr2=0x7f71d815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/2908632801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 0x7f71d815d560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71c80098e0 tx=0x7f71c80091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 -- 172.21.15.37:0/2908632801 shutdown_connections 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/2908632801 >> v2:172.21.15.83:3300/0 conn(0x7f71d80ad800 0x7f71d815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/2908632801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b5e30 0x7f71d815d560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 -- 172.21.15.37:0/2908632801 >> 172.21.15.37:0/2908632801 conn(0x7f71d8099a10 msgr2=0x7f71d806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 -- 172.21.15.37:0/2908632801 shutdown_connections 2023-10-06T04:17:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.539+0000 7f71dd2a0700 1 -- 172.21.15.37:0/2908632801 wait complete. 2023-10-06T04:17:28.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 Processor -- start 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 -- start start 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d80b5e30 0x7f71d809a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b6200 0x7f71d80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809b5b0 con 0x7f71d80ad800 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8148840 con 0x7f71d80b5e30 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71dd2a0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809a9a0 con 0x7f71d80b6200 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49746/0 (socket says 172.21.15.37:49746) 2023-10-06T04:17:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.541+0000 7f71d6ffd700 1 -- 172.21.15.37:0/3177912878 learned_addr learned my addr 172.21.15.37:0/3177912878 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d67fc700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d80b5e30 0x7f71d809a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d77fe700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b6200 0x7f71d80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 -- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b6200 msgr2=0x7f71d80c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b6200 0x7f71d80c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 -- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d80b5e30 msgr2=0x7f71d809a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d80b5e30 0x7f71d809a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 -- 172.21.15.37:0/3177912878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009a20 con 0x7f71d80ad800 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71d6ffd700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71c80093f0 tx=0x7f71c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8000bc0 con 0x7f71d80ad800 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800b910 con 0x7f71d80ad800 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8009420 con 0x7f71d80ad800 2023-10-06T04:17:28.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8025670 con 0x7f71d80ad800 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.542+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d809af60 con 0x7f71d80ad800 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.543+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80b2f90 con 0x7f71d80ad800 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.544+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71c8023070 con 0x7f71d80ad800 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.544+0000 7f71beffd700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 0x7f71c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.544+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71c80859c0 con 0x7f71d80ad800 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.544+0000 7f71d67fc700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 0x7f71c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.545+0000 7f71d67fc700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 0x7f71c40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71d8156af0 tx=0x7f71cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.548+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71c8052ad0 con 0x7f71d80ad800 2023-10-06T04:17:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.824+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f71d80ae680 con 0x7f71d80ad800 2023-10-06T04:17:28.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.853+0000 7f71beffd700 1 -- 172.21.15.37:0/3177912878 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v55) v1 ==== 123+0+0 (secure 0 0 0) 0x7f71c80150c0 con 0x7f71d80ad800 2023-10-06T04:17:28.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 msgr2=0x7f71c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 0x7f71c40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71d8156af0 tx=0x7f71cc009040 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 msgr2=0x7f71d8148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71c80093f0 tx=0x7f71c8017000 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 shutdown_connections 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f71d80b6200 0x7f71d80c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d80ad800 0x7f71d8148300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f71c4066f30 0x7f71c40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 --2- 172.21.15.37:0/3177912878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71d80b5e30 0x7f71d809a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 >> 172.21.15.37:0/3177912878 conn(0x7f71d8099a10 msgr2=0x7f71d81571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:28.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 shutdown_connections 2023-10-06T04:17:28.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.855+0000 7f71dd2a0700 1 -- 172.21.15.37:0/3177912878 wait complete. 2023-10-06T04:17:28.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:17:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.989+0000 7f77b81d5700 1 Processor -- start 2023-10-06T04:17:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.989+0000 7f77b81d5700 1 -- start start 2023-10-06T04:17:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b81d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 0x7f77b00ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b81d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b00ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b81d5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00cdb20 con 0x7f77b00cf530 2023-10-06T04:17:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b81d5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00cf9d0 con 0x7f77b0159dc0 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b81d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b3090 con 0x7f77b00ce260 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b6772700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77b00cf530 0x7f77b00c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53958/0 (socket says 172.21.15.37:53958) 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b6772700 1 -- 172.21.15.37:0/1683444784 learned_addr learned my addr 172.21.15.37:0/1683444784 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5f71700 1 --2- 172.21.15.37:0/1683444784 >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 0x7f77b00ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5770700 1 --2- 172.21.15.37:0/1683444784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b00ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b4f6f700 1 -- 172.21.15.37:0/1683444784 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691104564 0 0) 0x7f77b00cdb20 con 0x7f77b00cf530 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b4f6f700 1 -- 172.21.15.37:0/1683444784 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7798003570 con 0x7f77b00cf530 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5770700 1 -- 172.21.15.37:0/1683444784 >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 msgr2=0x7f77b00ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5770700 1 --2- 172.21.15.37:0/1683444784 >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 0x7f77b00ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5770700 1 -- 172.21.15.37:0/1683444784 >> v1:172.21.15.37:6789/0 conn(0x7f77b00cf530 legacy=0x7f77b00c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.990+0000 7f77b5770700 1 -- 172.21.15.37:0/1683444784 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00c5430 con 0x7f77b00ce260 2023-10-06T04:17:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b5f71700 1 --2- 172.21.15.37:0/1683444784 >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 0x7f77b00ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b5770700 1 --2- 172.21.15.37:0/1683444784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b00ceff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77a40098e0 tx=0x7f77a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49619e62aa4581d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b4f6f700 1 -- 172.21.15.37:0/1683444784 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011630 con 0x7f77b00ce260 2023-10-06T04:17:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b4f6f700 1 -- 172.21.15.37:0/1683444784 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4011790 con 0x7f77b00ce260 2023-10-06T04:17:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b4f6f700 1 -- 172.21.15.37:0/1683444784 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011b10 con 0x7f77b00ce260 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 -- 172.21.15.37:0/1683444784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 msgr2=0x7f77b00ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 --2- 172.21.15.37:0/1683444784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b00ceff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77a40098e0 tx=0x7f77a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 -- 172.21.15.37:0/1683444784 shutdown_connections 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 --2- 172.21.15.37:0/1683444784 >> v2:172.21.15.83:3300/0 conn(0x7f77b0159dc0 0x7f77b00ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 --2- 172.21.15.37:0/1683444784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b00ceff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.991+0000 7f77b81d5700 1 -- 172.21.15.37:0/1683444784 >> 172.21.15.37:0/1683444784 conn(0x7f77b0099a50 msgr2=0x7f77b006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.992+0000 7f77b81d5700 1 -- 172.21.15.37:0/1683444784 shutdown_connections 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.992+0000 7f77b81d5700 1 -- 172.21.15.37:0/1683444784 wait complete. 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 Processor -- start 2023-10-06T04:17:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 -- start start 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b013c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77b0159dc0 0x7f77b0158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b013cca0 con 0x7f77b00cf530 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c9110 con 0x7f77b0159dc0 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.993+0000 7f77b81d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c8500 con 0x7f77b00ce260 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49754/0 (socket says 172.21.15.37:49754) 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 -- 172.21.15.37:0/523491548 learned_addr learned my addr 172.21.15.37:0/523491548 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b6772700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77b0159dc0 0x7f77b0158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5f71700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 -- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 msgr2=0x7f77b013c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b013c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 -- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77b0159dc0 msgr2=0x7f77b0158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77b0159dc0 0x7f77b0158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 -- 172.21.15.37:0/523491548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009a20 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b5770700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009ed0 tx=0x7f77a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011900 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4011a80 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a4009420 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.994+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a401a680 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.995+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00c8ac0 con 0x7f77b00cf530 2023-10-06T04:17:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.996+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b004c3c0 con 0x7f77b00cf530 2023-10-06T04:17:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.996+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77a401aab0 con 0x7f77b00cf530 2023-10-06T04:17:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.996+0000 7f77adffb700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 0x7f779c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.996+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77a4086180 con 0x7f77b00cf530 2023-10-06T04:17:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.996+0000 7f77b5f71700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 0x7f779c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:28.997+0000 7f77b5f71700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 0x7f779c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77a800f750 tx=0x7f77a800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.001+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77a4053290 con 0x7f77b00cf530 2023-10-06T04:17:29.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.192+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f77b0067fd0 con 0x7f77b00cf530 2023-10-06T04:17:29.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.196+0000 7f77adffb700 1 -- 172.21.15.37:0/523491548 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f77a40568b0 con 0x7f77b00cf530 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 msgr2=0x7f779c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 0x7f779c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77a800f750 tx=0x7f77a800b040 comp rx=0 tx=0).stop 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 msgr2=0x7f77b0157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009ed0 tx=0x7f77a4017000 comp rx=0 tx=0).stop 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 shutdown_connections 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f779c066f30 0x7f779c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77b0159dc0 0x7f77b0158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77b00ce260 0x7f77b013c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 --2- 172.21.15.37:0/523491548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77b00cf530 0x7f77b0157e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 >> 172.21.15.37:0/523491548 conn(0x7f77b0099a50 msgr2=0x7f77b00cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:29.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 shutdown_connections 2023-10-06T04:17:29.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.198+0000 7f77b81d5700 1 -- 172.21.15.37:0/523491548 wait complete. 2023-10-06T04:17:29.212 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:17:29.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:17:29.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:17:29.297 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:17:29.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:17:29.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:29.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:17:29.333 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:17:29.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:29.333 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:17:29.388 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:17:29.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:29.388 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:17:29.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:17:29.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:29.429 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:17:29.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:17:29.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:29.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:17:29.519 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:17:29.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:29.519 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:17:29.574 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:17:29.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:29.575 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:17:29.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:17:29.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:29.611 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:17:29.667 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:17:29.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.784+0000 7ff6f4ffe700 1 Processor -- start 2023-10-06T04:17:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.784+0000 7ff6f4ffe700 1 -- start start 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.785+0000 7ff6f4ffe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff6f00b3740 0x7ff6f00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.785+0000 7ff6f4ffe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 0x7ff6f00b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.785+0000 7ff6f4ffe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f00b6530 con 0x7ff6f00aaea0 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.785+0000 7ff6f4ffe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f00ce710 con 0x7ff6f00b3740 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.785+0000 7ff6f4ffe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f0159e20 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff6f00b3740 0x7ff6f00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6eed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 0x7ff6f00b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6edd9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff6f00aaea0 0x7ff6f00b4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:39890/0 (socket says 172.21.15.37:39890) 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6edd9b700 1 -- 172.21.15.37:0/362084431 learned_addr learned my addr 172.21.15.37:0/362084431 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/362084431 >> v2:172.21.15.83:3300/0 conn(0x7ff6f00b3740 0x7ff6f00b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.37:50864/0 (socket says 172.21.15.37:50864) 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 -- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 msgr2=0x7ff6f00b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 0x7ff6f00b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 -- 172.21.15.37:0/362084431 >> v1:172.21.15.83:6789/0 conn(0x7ff6f00aaea0 legacy=0x7ff6f00b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 -- 172.21.15.37:0/362084431 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f00cdb00 con 0x7ff6f00b3740 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6eed9d700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 0x7ff6f00b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00b3740 0x7ff6f00b3b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098d0 tx=0x7ff6e0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac05aa141fae236c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ed59a700 1 -- 172.21.15.37:0/362084431 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0005c10 con 0x7ff6f00b3740 2023-10-06T04:17:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ed59a700 1 -- 172.21.15.37:0/362084431 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e0005d70 con 0x7ff6f00b3740 2023-10-06T04:17:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.786+0000 7ff6ed59a700 1 -- 172.21.15.37:0/362084431 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0006280 con 0x7ff6f00b3740 2023-10-06T04:17:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00b3740 msgr2=0x7ff6f00b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00b3740 0x7ff6f00b3b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00098d0 tx=0x7ff6e0009120 comp rx=0 tx=0).stop 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/362084431 shutdown_connections 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00cfbb0 0x7ff6f00b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/362084431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00b3740 0x7ff6f00b3b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/362084431 >> 172.21.15.37:0/362084431 conn(0x7ff6f0099a10 msgr2=0x7ff6f006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/362084431 shutdown_connections 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.787+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/362084431 wait complete. 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.788+0000 7ff6f4ffe700 1 Processor -- start 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.788+0000 7ff6f4ffe700 1 -- start start 2023-10-06T04:17:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 0x7ff6f0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00b3740 0x7ff6f015f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00b2790 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00b0a00 con 0x7ff6f00aaea0 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6f4ffe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f016d8f0 con 0x7ff6f00b3740 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6ee59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 0x7ff6f0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49756/0 (socket says 172.21.15.37:49756) 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 -- 172.21.15.37:0/697268810 learned_addr learned my addr 172.21.15.37:0/697268810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6edd9b700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00b3740 0x7ff6f015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 -- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00b3740 msgr2=0x7ff6f015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00b3740 0x7ff6f015f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 -- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 msgr2=0x7ff6f0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 0x7ff6f0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.789+0000 7ff6eed9d700 1 -- 172.21.15.37:0/697268810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8009a20 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 0x7ff6f0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6eed9d700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009fc0 tx=0x7ff6e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8009d20 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800f040 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00093c0 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800ce20 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.790+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f016deb0 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.791+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f0063410 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.791+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6e8003020 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.792+0000 7ff6e67fc700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 0x7ff6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.792+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6e8084ee0 con 0x7ff6f00cfbb0 2023-10-06T04:17:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.792+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 0x7ff6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.792+0000 7ff6ee59c700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 0x7ff6d00693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009160 tx=0x7ff6e0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:29.796+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6e8055a80 con 0x7ff6f00cfbb0 2023-10-06T04:17:30.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.034+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6f008a7c0 con 0x7ff6f00cfbb0 2023-10-06T04:17:30.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.034+0000 7ff6e67fc700 1 -- 172.21.15.37:0/697268810 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7ff6e8055610 con 0x7ff6f00cfbb0 2023-10-06T04:17:30.036 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:30.036 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 msgr2=0x7ff6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 0x7ff6d00693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009160 tx=0x7ff6e0016000 comp rx=0 tx=0).stop 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 msgr2=0x7ff6f01559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009fc0 tx=0x7ff6e800b040 comp rx=0 tx=0).stop 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 shutdown_connections 2023-10-06T04:17:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6f00cfbb0 0x7ff6f01559f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff6d0066f30 0x7ff6d00693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6f00aaea0 0x7ff6f0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 --2- 172.21.15.37:0/697268810 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6f00b3740 0x7ff6f015f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 >> 172.21.15.37:0/697268810 conn(0x7ff6f0099a10 msgr2=0x7ff6f00b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 shutdown_connections 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.036+0000 7ff6f4ffe700 1 -- 172.21.15.37:0/697268810 wait complete. 2023-10-06T04:17:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:30.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:30.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.169+0000 7fd0df41e700 1 Processor -- start 2023-10-06T04:17:30.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.169+0000 7fd0df41e700 1 -- start start 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0d80b2810 0x7fd0d80cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80ce780 0x7fd0d815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd0d80ccbb0 0x7fd0d80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d8159b40 con 0x7fd0d80b2810 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d80cebf0 con 0x7fd0d80ccbb0 2023-10-06T04:17:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0df41e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80cfa20 con 0x7fd0d80ce780 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0d80b2810 0x7fd0d80cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0d80b2810 0x7fd0d80cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49764/0 (socket says 172.21.15.37:49764) 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 -- 172.21.15.37:0/2216160543 learned_addr learned my addr 172.21.15.37:0/2216160543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0ddc1b700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80ce780 0x7fd0d815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0dec1d700 1 --2- 172.21.15.37:0/2216160543 >> v2:172.21.15.83:3300/0 conn(0x7fd0d80ccbb0 0x7fd0d80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 -- 172.21.15.37:0/2216160543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80ce780 msgr2=0x7fd0d815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80ce780 0x7fd0d815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 -- 172.21.15.37:0/2216160543 >> v2:172.21.15.83:3300/0 conn(0x7fd0d80ccbb0 msgr2=0x7fd0d80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 --2- 172.21.15.37:0/2216160543 >> v2:172.21.15.83:3300/0 conn(0x7fd0d80ccbb0 0x7fd0d80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.170+0000 7fd0de41c700 1 -- 172.21.15.37:0/2216160543 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d815e140 con 0x7fd0d80b2810 2023-10-06T04:17:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0de41c700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80b2810 0x7fd0d80cfeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80caa60 tx=0x7fd0c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6683a74800a9e436 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0dd41a700 1 -- 172.21.15.37:0/2216160543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800e070 con 0x7fd0d80b2810 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0dd41a700 1 -- 172.21.15.37:0/2216160543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800b930 con 0x7fd0d80b2810 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0dd41a700 1 -- 172.21.15.37:0/2216160543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80092e0 con 0x7fd0d80b2810 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 -- 172.21.15.37:0/2216160543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80b2810 msgr2=0x7fd0d80cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80b2810 0x7fd0d80cfeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80caa60 tx=0x7fd0c8009840 comp rx=0 tx=0).stop 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 -- 172.21.15.37:0/2216160543 shutdown_connections 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 --2- 172.21.15.37:0/2216160543 >> v2:172.21.15.83:3300/0 conn(0x7fd0d80ccbb0 0x7fd0d80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80b2810 0x7fd0d80cfeb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 --2- 172.21.15.37:0/2216160543 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80ce780 0x7fd0d815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 -- 172.21.15.37:0/2216160543 >> 172.21.15.37:0/2216160543 conn(0x7fd0d806ed90 msgr2=0x7fd0d806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 -- 172.21.15.37:0/2216160543 shutdown_connections 2023-10-06T04:17:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.171+0000 7fd0df41e700 1 -- 172.21.15.37:0/2216160543 wait complete. 2023-10-06T04:17:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.172+0000 7fd0df41e700 1 Processor -- start 2023-10-06T04:17:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 -- start start 2023-10-06T04:17:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0d80ccbb0 0x7fd0d816c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815c9c0 con 0x7fd0d80ce780 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c7a80 con 0x7fd0d80ccbb0 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0df41e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815bd40 con 0x7fd0d80b2810 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0de41c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0dec1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0de41c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:55450/0 (socket says 172.21.15.37:55450) 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0dec1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49776/0 (socket says 172.21.15.37:49776) 2023-10-06T04:17:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0de41c700 1 -- 172.21.15.37:0/1497271850 learned_addr learned my addr 172.21.15.37:0/1497271850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.173+0000 7fd0ddc1b700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0d80ccbb0 0x7fd0d816c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 -- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 msgr2=0x7fd0d80c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 -- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0d80ccbb0 msgr2=0x7fd0d816c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0d80ccbb0 0x7fd0d816c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 -- 172.21.15.37:0/1497271850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009ae0 con 0x7fd0d80ce780 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0de41c700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0dec1d700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e950 tx=0x7fd0d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0013680 con 0x7fd0d80ce780 2023-10-06T04:17:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d0013800 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0013bc0 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d815c020 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.174+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d815c5e0 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.175+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d804c3c0 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.175+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0d000c3e0 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.176+0000 7fd0d67fc700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 0x7fd0c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.176+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd0d0084590 con 0x7fd0d80ce780 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.176+0000 7fd0de41c700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 0x7fd0c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.176+0000 7fd0de41c700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 0x7fd0c40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009fd0 tx=0x7fd0c8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.180+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0d00516a0 con 0x7fd0d80ce780 2023-10-06T04:17:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.374+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0d80cee10 con 0x7fd0d80ce780 2023-10-06T04:17:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.375+0000 7fd0d67fc700 1 -- 172.21.15.37:0/1497271850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fd0d0054cc0 con 0x7fd0d80ce780 2023-10-06T04:17:30.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:30.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 msgr2=0x7fd0c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 0x7fd0c40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009fd0 tx=0x7fd0c8018000 comp rx=0 tx=0).stop 2023-10-06T04:17:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 msgr2=0x7fd0d80b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e950 tx=0x7fd0d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 shutdown_connections 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d80ce780 0x7fd0d80b0550 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd0d80b2810 0x7fd0d80c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd0c4066f30 0x7fd0c40693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 --2- 172.21.15.37:0/1497271850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0d80ccbb0 0x7fd0d816c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 >> 172.21.15.37:0/1497271850 conn(0x7fd0d806ed90 msgr2=0x7fd0d8157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 shutdown_connections 2023-10-06T04:17:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.377+0000 7fd0df41e700 1 -- 172.21.15.37:0/1497271850 wait complete. 2023-10-06T04:17:30.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:16:53.780037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:16:55.019362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:17:30.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:30.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.513+0000 7f67f8f89700 1 Processor -- start 2023-10-06T04:17:30.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.513+0000 7f67f8f89700 1 -- start start 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67f41539c0 0x7f67f4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f67f4153d90 0x7f67f40b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 0x7f67f40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40d0cc0 con 0x7f67f41539c0 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40b5ff0 con 0x7f67f4153d90 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f8f89700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40b53e0 con 0x7f67f40d02e0 2023-10-06T04:17:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67f41539c0 0x7f67f4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67f41539c0 0x7f67f4159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49784/0 (socket says 172.21.15.37:49784) 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 -- 172.21.15.37:0/2340114600 learned_addr learned my addr 172.21.15.37:0/2340114600 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f3fff700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 0x7f67f40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f2ffd700 1 --2- 172.21.15.37:0/2340114600 >> v2:172.21.15.83:3300/0 conn(0x7f67f4153d90 0x7f67f40b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 -- 172.21.15.37:0/2340114600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 msgr2=0x7f67f40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 0x7f67f40d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 -- 172.21.15.37:0/2340114600 >> v2:172.21.15.83:3300/0 conn(0x7f67f4153d90 msgr2=0x7f67f40b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 --2- 172.21.15.37:0/2340114600 >> v2:172.21.15.83:3300/0 conn(0x7f67f4153d90 0x7f67f40b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 -- 172.21.15.37:0/2340114600 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40b56c0 con 0x7f67f41539c0 2023-10-06T04:17:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f3fff700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 0x7f67f40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f37fe700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f41539c0 0x7f67f4159b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af260 tx=0x7f67dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d08115b0537fb54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.514+0000 7f67f27fc700 1 -- 172.21.15.37:0/2340114600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc009e70 con 0x7f67f41539c0 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f27fc700 1 -- 172.21.15.37:0/2340114600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc00b860 con 0x7f67f41539c0 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f27fc700 1 -- 172.21.15.37:0/2340114600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00bc00 con 0x7f67f41539c0 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 -- 172.21.15.37:0/2340114600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f41539c0 msgr2=0x7f67f4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f41539c0 0x7f67f4159b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af260 tx=0x7f67dc009250 comp rx=0 tx=0).stop 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 -- 172.21.15.37:0/2340114600 shutdown_connections 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f40d02e0 0x7f67f40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 --2- 172.21.15.37:0/2340114600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f41539c0 0x7f67f4159b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 --2- 172.21.15.37:0/2340114600 >> v2:172.21.15.83:3300/0 conn(0x7f67f4153d90 0x7f67f40b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 -- 172.21.15.37:0/2340114600 >> 172.21.15.37:0/2340114600 conn(0x7f67f406ed90 msgr2=0x7f67f406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 -- 172.21.15.37:0/2340114600 shutdown_connections 2023-10-06T04:17:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.515+0000 7f67f8f89700 1 -- 172.21.15.37:0/2340114600 wait complete. 2023-10-06T04:17:30.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.516+0000 7f67f8f89700 1 Processor -- start 2023-10-06T04:17:30.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.516+0000 7f67f8f89700 1 -- start start 2023-10-06T04:17:30.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 0x7f67f40a7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67f4153d90 0x7f67f40a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4152a40 con 0x7f67f40d02e0 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41577c0 con 0x7f67f4153d90 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f8f89700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4158060 con 0x7f67f41539c0 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49792/0 (socket says 172.21.15.37:49792) 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 -- 172.21.15.37:0/3758629134 learned_addr learned my addr 172.21.15.37:0/3758629134 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f2ffd700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 0x7f67f40a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f3fff700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67f4153d90 0x7f67f40a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 -- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 msgr2=0x7f67f40a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 0x7f67f40a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 -- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67f4153d90 msgr2=0x7f67f40a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67f4153d90 0x7f67f40a7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f37fe700 1 -- 172.21.15.37:0/3758629134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0094f0 con 0x7f67f40d02e0 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.517+0000 7f67f2ffd700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 0x7f67f40a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67f37fe700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009290 tx=0x7f67dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00bbe0 con 0x7f67f40d02e0 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc01a450 con 0x7f67f40d02e0 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f4156ab0 con 0x7f67f40d02e0 2023-10-06T04:17:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc01a810 con 0x7f67f40d02e0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.518+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f4157cf0 con 0x7f67f40d02e0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.519+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f404c3c0 con 0x7f67f40d02e0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.519+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67dc01ab80 con 0x7f67f40d02e0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.520+0000 7f67eb7fe700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 0x7f67d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.520+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f67dc085c50 con 0x7f67f40d02e0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.520+0000 7f67f2ffd700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 0x7f67d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.520+0000 7f67f2ffd700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 0x7f67d40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67f4157750 tx=0x7f67e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.524+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67dc08b020 con 0x7f67f40d02e0 2023-10-06T04:17:30.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.718+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67f40aff80 con 0x7f67f40d02e0 2023-10-06T04:17:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.718+0000 7f67eb7fe700 1 -- 172.21.15.37:0/3758629134 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67dc02a0a0 con 0x7f67f40d02e0 2023-10-06T04:17:30.720 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 msgr2=0x7f67d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 0x7f67d40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67f4157750 tx=0x7f67e4008040 comp rx=0 tx=0).stop 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 msgr2=0x7f67f4152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009290 tx=0x7f67dc017000 comp rx=0 tx=0).stop 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 shutdown_connections 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f67d4066f30 0x7f67d40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67f4153d90 0x7f67f40a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f40d02e0 0x7f67f4152500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 --2- 172.21.15.37:0/3758629134 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f67f41539c0 0x7f67f40a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 >> 172.21.15.37:0/3758629134 conn(0x7f67f406ed90 msgr2=0x7f67f40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 shutdown_connections 2023-10-06T04:17:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.720+0000 7f67f8f89700 1 -- 172.21.15.37:0/3758629134 wait complete. 2023-10-06T04:17:30.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.853+0000 7f286d96f700 1 Processor -- start 2023-10-06T04:17:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.853+0000 7f286d96f700 1 -- start start 2023-10-06T04:17:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f286d96f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f28681517d0 0x7f286806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f286d96f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 0x7f286806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f286d96f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286815b010 con 0x7f2868151ba0 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f286d96f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2868158650 con 0x7f28681517d0 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f286d96f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286815b8b0 con 0x7f2868158200 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f28667fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2868151ba0 0x7f2868157af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53962/0 (socket says 172.21.15.37:53962) 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f28667fc700 1 -- 172.21.15.37:0/3986931172 learned_addr learned my addr 172.21.15.37:0/3986931172 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f2866ffd700 1 --2- 172.21.15.37:0/3986931172 >> v2:172.21.15.83:3300/0 conn(0x7f28681517d0 0x7f286806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f28677fe700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 0x7f286806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f2866ffd700 1 -- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 msgr2=0x7f286806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f2866ffd700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 0x7f286806be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f2866ffd700 1 -- 172.21.15.37:0/3986931172 >> v1:172.21.15.37:6789/0 conn(0x7f2868151ba0 legacy=0x7f2868157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f2866ffd700 1 -- 172.21.15.37:0/3986931172 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868158860 con 0x7f28681517d0 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.854+0000 7f28677fe700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 0x7f286806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:30.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.855+0000 7f2866ffd700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28681517d0 0x7f286806b8d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28580098e0 tx=0x7f28580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554b5110b2428001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f2865ffb700 1 -- 172.21.15.37:0/3986931172 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800b640 con 0x7f28681517d0 2023-10-06T04:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f2865ffb700 1 -- 172.21.15.37:0/3986931172 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800b7a0 con 0x7f28681517d0 2023-10-06T04:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f2865ffb700 1 -- 172.21.15.37:0/3986931172 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800bb40 con 0x7f28681517d0 2023-10-06T04:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 -- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28681517d0 msgr2=0x7f286806b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28681517d0 0x7f286806b8d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28580098e0 tx=0x7f28580091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 -- 172.21.15.37:0/3986931172 shutdown_connections 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868158200 0x7f286806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 --2- 172.21.15.37:0/3986931172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28681517d0 0x7f286806b8d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 -- 172.21.15.37:0/3986931172 >> 172.21.15.37:0/3986931172 conn(0x7f2868068130 msgr2=0x7f28680ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 -- 172.21.15.37:0/3986931172 shutdown_connections 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.856+0000 7f286d96f700 1 -- 172.21.15.37:0/3986931172 wait complete. 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.857+0000 7f286d96f700 1 Processor -- start 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 -- start start 2023-10-06T04:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 0x7f286814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868158200 0x7f2868167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286815d850 con 0x7f28681517d0 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286815cc40 con 0x7f2868158200 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f286d96f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286815cf20 con 0x7f2868151ba0 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f2866ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f2866ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49800/0 (socket says 172.21.15.37:49800) 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f2866ffd700 1 -- 172.21.15.37:0/1120268069 learned_addr learned my addr 172.21.15.37:0/1120268069 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f28677fe700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868158200 0x7f2868167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.858+0000 7f28667fc700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 0x7f286814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 -- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 msgr2=0x7f286814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 0x7f286814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 -- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868158200 msgr2=0x7f2868167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868158200 0x7f2868167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 -- 172.21.15.37:0/1120268069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009a20 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f28667fc700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 0x7f286814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f2866ffd700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28680c5150 tx=0x7f2858017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285801bda0 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858011420 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858009420 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580117e0 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.859+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286815d4e0 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.860+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286804c3c0 con 0x7f28681517d0 2023-10-06T04:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.860+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2858011b90 con 0x7f28681517d0 2023-10-06T04:17:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.861+0000 7f284effd700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 0x7f28540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.861+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2858085ba0 con 0x7f28681517d0 2023-10-06T04:17:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.861+0000 7f28667fc700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 0x7f28540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.861+0000 7f28667fc700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 0x7f28540693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28680b19e0 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:30.865+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2858052d70 con 0x7f28681517d0 2023-10-06T04:17:31.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.057+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f286815b260 con 0x7f28681517d0 2023-10-06T04:17:31.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.058+0000 7f284effd700 1 -- 172.21.15.37:0/1120268069 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2858056390 con 0x7f28681517d0 2023-10-06T04:17:31.060 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 msgr2=0x7f28540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 0x7f28540693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28680b19e0 tx=0x7f285c009040 comp rx=0 tx=0).stop 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 msgr2=0x7f286815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28680c5150 tx=0x7f2858017000 comp rx=0 tx=0).stop 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 shutdown_connections 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2854066f30 0x7f28540693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868158200 0x7f2868167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28681517d0 0x7f286815c410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 --2- 172.21.15.37:0/1120268069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2868151ba0 0x7f286814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 >> 172.21.15.37:0/1120268069 conn(0x7f2868068130 msgr2=0x7f286806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 shutdown_connections 2023-10-06T04:17:31.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.060+0000 7f286d96f700 1 -- 172.21.15.37:0/1120268069 wait complete. 2023-10-06T04:17:31.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:17:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 Processor -- start 2023-10-06T04:17:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 -- start start 2023-10-06T04:17:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54157500 0x7f6e5415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 0x7f6e540b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e54157d70 con 0x7f6e540b0540 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.194+0000 7f6e58812700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540b0980 con 0x7f6e54157500 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e58812700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5415b420 con 0x7f6e541578d0 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54157500 0x7f6e5415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e54157500 0x7f6e5415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49810/0 (socket says 172.21.15.37:49810) 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 -- 172.21.15.37:0/49528561 learned_addr learned my addr 172.21.15.37:0/49528561 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e51d9b700 1 --2- 172.21.15.37:0/49528561 >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 0x7f6e540b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 -- 172.21.15.37:0/49528561 >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 msgr2=0x7f6e540b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 --2- 172.21.15.37:0/49528561 >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 0x7f6e540b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 -- 172.21.15.37:0/49528561 >> v1:172.21.15.83:6789/0 conn(0x7f6e540b0540 legacy=0x7f6e5406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 -- 172.21.15.37:0/49528561 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5415b9e0 con 0x7f6e54157500 2023-10-06T04:17:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e51d9b700 1 --2- 172.21.15.37:0/49528561 >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 0x7f6e540b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5259c700 1 --2- 172.21.15.37:0/49528561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54157500 0x7f6e5415be70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406b630 tx=0x7f6e4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39643c1ee1ef38b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5159a700 1 -- 172.21.15.37:0/49528561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00b820 con 0x7f6e54157500 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5159a700 1 -- 172.21.15.37:0/49528561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00b980 con 0x7f6e54157500 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.195+0000 7f6e5159a700 1 -- 172.21.15.37:0/49528561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00bd20 con 0x7f6e54157500 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 -- 172.21.15.37:0/49528561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54157500 msgr2=0x7f6e5415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 --2- 172.21.15.37:0/49528561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54157500 0x7f6e5415be70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406b630 tx=0x7f6e4c009250 comp rx=0 tx=0).stop 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 -- 172.21.15.37:0/49528561 shutdown_connections 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 --2- 172.21.15.37:0/49528561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e54157500 0x7f6e5415be70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 --2- 172.21.15.37:0/49528561 >> v2:172.21.15.83:3300/0 conn(0x7f6e541578d0 0x7f6e540b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 -- 172.21.15.37:0/49528561 >> 172.21.15.37:0/49528561 conn(0x7f6e540ce680 msgr2=0x7f6e540cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 -- 172.21.15.37:0/49528561 shutdown_connections 2023-10-06T04:17:31.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.196+0000 7f6e58812700 1 -- 172.21.15.37:0/49528561 wait complete. 2023-10-06T04:17:31.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.197+0000 7f6e58812700 1 Processor -- start 2023-10-06T04:17:31.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.197+0000 7f6e58812700 1 -- start start 2023-10-06T04:17:31.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e540b0540 0x7f6e54153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54157500 0x7f6e540ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541688a0 con 0x7f6e541578d0 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54167c90 con 0x7f6e54157500 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e58812700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54167f70 con 0x7f6e540b0540 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49818/0 (socket says 172.21.15.37:49818) 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 -- 172.21.15.37:0/207997010 learned_addr learned my addr 172.21.15.37:0/207997010 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e51d9b700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54157500 0x7f6e540ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e5259c700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e540b0540 0x7f6e54153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 -- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e540b0540 msgr2=0x7f6e54153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e540b0540 0x7f6e54153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 -- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54157500 msgr2=0x7f6e540ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54157500 0x7f6e540ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 -- 172.21.15.37:0/207997010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0094f0 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e52d9d700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400bc30 tx=0x7f6e44009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.198+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400c9b0 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.199+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400cb50 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.199+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e54168250 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.199+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44014410 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.199+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e54167960 con 0x7f6e541578d0 2023-10-06T04:17:31.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.199+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5404c3c0 con 0x7f6e541578d0 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.200+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e44014800 con 0x7f6e541578d0 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.200+0000 7f6e4a7fc700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 0x7f6e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.200+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e44084780 con 0x7f6e541578d0 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.200+0000 7f6e5259c700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 0x7f6e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.201+0000 7f6e5259c700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 0x7f6e340693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406b630 tx=0x7f6e4c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.204+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e44051890 con 0x7f6e541578d0 2023-10-06T04:17:31.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.396+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e540b0ba0 con 0x7f6e541578d0 2023-10-06T04:17:31.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.396+0000 7f6e4a7fc700 1 -- 172.21.15.37:0/207997010 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e44054eb0 con 0x7f6e541578d0 2023-10-06T04:17:31.398 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:17:31.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 msgr2=0x7f6e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 0x7f6e340693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e5406b630 tx=0x7f6e4c016000 comp rx=0 tx=0).stop 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 msgr2=0x7f6e540c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400bc30 tx=0x7f6e44009820 comp rx=0 tx=0).stop 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 shutdown_connections 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e541578d0 0x7f6e540c8250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6e540b0540 0x7f6e54153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6e34066f30 0x7f6e340693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 --2- 172.21.15.37:0/207997010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e54157500 0x7f6e540ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 >> 172.21.15.37:0/207997010 conn(0x7f6e540ce680 msgr2=0x7f6e540cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 shutdown_connections 2023-10-06T04:17:31.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.399+0000 7f6e58812700 1 -- 172.21.15.37:0/207997010 wait complete. 2023-10-06T04:17:31.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:17:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.534+0000 7f831a870700 1 Processor -- start 2023-10-06T04:17:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.534+0000 7f831a870700 1 -- start start 2023-10-06T04:17:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.534+0000 7f831a870700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8314159dc0 0x7f83140ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f831a870700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140cf700 0x7f83140cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f831a870700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140cdb20 con 0x7f83140ce260 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f831a870700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140b3090 con 0x7f8314159dc0 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f831a870700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140c5430 con 0x7f83140cf700 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8314159dc0 0x7f83140ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f83137fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83140ce260 0x7f83140ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53966/0 (socket says 172.21.15.37:53966) 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f83137fe700 1 -- 172.21.15.37:0/875165863 learned_addr learned my addr 172.21.15.37:0/875165863 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8318e0d700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140cf700 0x7f83140cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 -- 172.21.15.37:0/875165863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140cf700 msgr2=0x7f83140cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140cf700 0x7f83140cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 -- 172.21.15.37:0/875165863 >> v1:172.21.15.37:6789/0 conn(0x7f83140ce260 legacy=0x7f83140ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8312ffd700 1 -- 172.21.15.37:0/875165863 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254492730 0 0) 0x7f83140cdb20 con 0x7f83140ce260 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 -- 172.21.15.37:0/875165863 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140c6290 con 0x7f8314159dc0 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8313fff700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f83140ad140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098d0 tx=0x7f82fc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f85b4bd0845b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8312ffd700 1 -- 172.21.15.37:0/875165863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc009e70 con 0x7f8314159dc0 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8312ffd700 1 -- 172.21.15.37:0/875165863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc005c10 con 0x7f8314159dc0 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.535+0000 7f8312ffd700 1 -- 172.21.15.37:0/875165863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc00b650 con 0x7f8314159dc0 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 -- 172.21.15.37:0/875165863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 msgr2=0x7f83140ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f83140ad140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098d0 tx=0x7f82fc009120 comp rx=0 tx=0).stop 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 -- 172.21.15.37:0/875165863 shutdown_connections 2023-10-06T04:17:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140cf700 0x7f83140cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 --2- 172.21.15.37:0/875165863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f83140ad140 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 -- 172.21.15.37:0/875165863 >> 172.21.15.37:0/875165863 conn(0x7f8314099a50 msgr2=0x7f831406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 -- 172.21.15.37:0/875165863 shutdown_connections 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.536+0000 7f831a870700 1 -- 172.21.15.37:0/875165863 wait complete. 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.537+0000 7f831a870700 1 Processor -- start 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.537+0000 7f831a870700 1 -- start start 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140ce260 0x7f83141567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 0x7f83140ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831409c3e0 con 0x7f8314159dc0 2023-10-06T04:17:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314156d10 con 0x7f83140cf700 2023-10-06T04:17:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f831a870700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140c9690 con 0x7f83140ce260 2023-10-06T04:17:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49834/0 (socket says 172.21.15.37:49834) 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 -- 172.21.15.37:0/1233838373 learned_addr learned my addr 172.21.15.37:0/1233838373 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8313fff700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140ce260 0x7f83141567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f83137fe700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 0x7f83140ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 -- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140ce260 msgr2=0x7f83141567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140ce260 0x7f83141567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 -- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 msgr2=0x7f83140ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 0x7f83140ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f8318e0d700 1 -- 172.21.15.37:0/1233838373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0093c0 con 0x7f8314159dc0 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.538+0000 7f83137fe700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 0x7f83140ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f8318e0d700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f830c007ed0 tx=0x7f830c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00ec40 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00eda0 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c014670 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831409bd90 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.539+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83140ca9b0 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.540+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831409bbf0 con 0x7f8314159dc0 2023-10-06T04:17:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.540+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f830c003020 con 0x7f8314159dc0 2023-10-06T04:17:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.541+0000 7f830bfff700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 0x7f82f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.541+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f830c084a20 con 0x7f8314159dc0 2023-10-06T04:17:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.541+0000 7f8313fff700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 0x7f82f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.541+0000 7f8313fff700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 0x7f82f40693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83141599a0 tx=0x7f82fc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.545+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f831409bbf0 con 0x7f8314159dc0 2023-10-06T04:17:31.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.737+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f831409bbf0 con 0x7f8314159dc0 2023-10-06T04:17:31.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.737+0000 7f830bfff700 1 -- 172.21.15.37:0/1233838373 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f831409bbf0 con 0x7f8314159dc0 2023-10-06T04:17:31.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:17:31.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 msgr2=0x7f82f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 0x7f82f40693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83141599a0 tx=0x7f82fc016000 comp rx=0 tx=0).stop 2023-10-06T04:17:31.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 msgr2=0x7f831409c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f830c007ed0 tx=0x7f830c009850 comp rx=0 tx=0).stop 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 shutdown_connections 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8314159dc0 0x7f831409c870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83140ce260 0x7f83141567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f82f4066f30 0x7f82f40693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 --2- 172.21.15.37:0/1233838373 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83140cf700 0x7f83140ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.739+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 >> 172.21.15.37:0/1233838373 conn(0x7f8314099a50 msgr2=0x7f8314069590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.740+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 shutdown_connections 2023-10-06T04:17:31.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.740+0000 7f831a870700 1 -- 172.21.15.37:0/1233838373 wait complete. 2023-10-06T04:17:31.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.872+0000 7f84792a9700 1 Processor -- start 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.872+0000 7f84792a9700 1 -- start start 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f847406e9a0 0x7f84740ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406ed70 0x7f84740ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84740ab470 0x7f84740ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740aac00 con 0x7f84740ab470 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740aa030 con 0x7f847406e9a0 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84792a9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740aa2d0 con 0x7f847406ed70 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84737fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84740ab470 0x7f84740ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84737fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84740ab470 0x7f84740ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49836/0 (socket says 172.21.15.37:49836) 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84737fe700 1 -- 172.21.15.37:0/3979317047 learned_addr learned my addr 172.21.15.37:0/3979317047 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f84727fc700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406ed70 0x7f84740ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.873+0000 7f8472ffd700 1 --2- 172.21.15.37:0/3979317047 >> v2:172.21.15.83:3300/0 conn(0x7f847406e9a0 0x7f84740ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 -- 172.21.15.37:0/3979317047 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406ed70 msgr2=0x7f84740ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406ed70 0x7f84740ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 -- 172.21.15.37:0/3979317047 >> v2:172.21.15.83:3300/0 conn(0x7f847406e9a0 msgr2=0x7f84740ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 --2- 172.21.15.37:0/3979317047 >> v2:172.21.15.83:3300/0 conn(0x7f847406e9a0 0x7f84740ad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 -- 172.21.15.37:0/3979317047 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740aa5b0 con 0x7f84740ab470 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84737fe700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84740ab470 0x7f84740ab8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84740696c0 tx=0x7f8464009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320687384d15b672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f8471ffb700 1 -- 172.21.15.37:0/3979317047 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400e070 con 0x7f84740ab470 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f8471ffb700 1 -- 172.21.15.37:0/3979317047 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400b970 con 0x7f84740ab470 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f8471ffb700 1 -- 172.21.15.37:0/3979317047 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640092e0 con 0x7f84740ab470 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84792a9700 1 -- 172.21.15.37:0/3979317047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84740ab470 msgr2=0x7f84740ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.874+0000 7f84792a9700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84740ab470 0x7f84740ab8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84740696c0 tx=0x7f8464009840 comp rx=0 tx=0).stop 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 -- 172.21.15.37:0/3979317047 shutdown_connections 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84740ab470 0x7f84740ab8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 --2- 172.21.15.37:0/3979317047 >> v2:172.21.15.83:3300/0 conn(0x7f847406e9a0 0x7f84740ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 --2- 172.21.15.37:0/3979317047 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f847406ed70 0x7f84740ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 -- 172.21.15.37:0/3979317047 >> 172.21.15.37:0/3979317047 conn(0x7f84740cc250 msgr2=0x7f84740cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 -- 172.21.15.37:0/3979317047 shutdown_connections 2023-10-06T04:17:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.875+0000 7f84792a9700 1 -- 172.21.15.37:0/3979317047 wait complete. 2023-10-06T04:17:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.876+0000 7f84792a9700 1 Processor -- start 2023-10-06T04:17:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.876+0000 7f84792a9700 1 -- start start 2023-10-06T04:17:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 0x7f8474154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 0x7f84741529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847414c3d0 con 0x7f847406e9a0 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847413df10 con 0x7f847406ed70 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847413e4d0 con 0x7f84740ab470 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49840/0 (socket says 172.21.15.37:49840) 2023-10-06T04:17:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 -- 172.21.15.37:0/317413582 learned_addr learned my addr 172.21.15.37:0/317413582 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84727fc700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 0x7f8474154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84737fe700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 0x7f84741529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 -- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 msgr2=0x7f84741529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 0x7f84741529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 -- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 msgr2=0x7f8474154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 0x7f8474154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:31.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 -- 172.21.15.37:0/317413582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464009ae0 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84727fc700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 0x7f8474154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84737fe700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 0x7f84741529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f8472ffd700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f846c00ec80 tx=0x7f846c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00c9d0 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00cb30 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8474152f20 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.877+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c013470 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.878+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8474155860 con 0x7f847406e9a0 2023-10-06T04:17:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.878+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8474063410 con 0x7f847406e9a0 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.879+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f846c013860 con 0x7f847406e9a0 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.879+0000 7f846affd700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.879+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f846c084db0 con 0x7f847406e9a0 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.880+0000 7f84727fc700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.880+0000 7f84727fc700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f845c006f00 tx=0x7f845c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:31.884+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f846c051ec0 con 0x7f847406e9a0 2023-10-06T04:17:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.121+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84740aa890 con 0x7f847406e9a0 2023-10-06T04:17:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.122+0000 7f846affd700 1 -- 172.21.15.37:0/317413582 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f846c017090 con 0x7f847406e9a0 2023-10-06T04:17:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:32.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 msgr2=0x7f84540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 0x7f84540693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f845c006f00 tx=0x7f845c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 msgr2=0x7f847413d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f846c00ec80 tx=0x7f846c009120 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 shutdown_connections 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84740ab470 0x7f84741529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f847406e9a0 0x7f847413d820 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8454066f30 0x7f84540693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 --2- 172.21.15.37:0/317413582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f847406ed70 0x7f8474154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 >> 172.21.15.37:0/317413582 conn(0x7f84740cc250 msgr2=0x7f84740a8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 shutdown_connections 2023-10-06T04:17:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.124+0000 7f84792a9700 1 -- 172.21.15.37:0/317413582 wait complete. 2023-10-06T04:17:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:32.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.256+0000 7fc26c9fe700 1 Processor -- start 2023-10-06T04:17:32.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.256+0000 7fc26c9fe700 1 -- start start 2023-10-06T04:17:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26c9fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc268140e10 0x7fc26806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26c9fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc26806daa0 0x7fc2680c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26c9fe700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2680c7cc0 con 0x7fc268140a40 2023-10-06T04:17:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26c9fe700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680c70b0 con 0x7fc26806daa0 2023-10-06T04:17:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26c9fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680c7390 con 0x7fc268140e10 2023-10-06T04:17:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc266d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc268140a40 0x7fc2680c66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53970/0 (socket says 172.21.15.37:53970) 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc26806daa0 0x7fc2680c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc266d9d700 1 -- 172.21.15.37:0/908868168 learned_addr learned my addr 172.21.15.37:0/908868168 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26659c700 1 --2- 172.21.15.37:0/908868168 >> v2:172.21.15.83:3300/0 conn(0x7fc268140e10 0x7fc26806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 -- 172.21.15.37:0/908868168 >> v2:172.21.15.83:3300/0 conn(0x7fc268140e10 msgr2=0x7fc26806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 --2- 172.21.15.37:0/908868168 >> v2:172.21.15.83:3300/0 conn(0x7fc268140e10 0x7fc26806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 -- 172.21.15.37:0/908868168 >> v1:172.21.15.37:6789/0 conn(0x7fc268140a40 legacy=0x7fc2680c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc265d9b700 1 -- 172.21.15.37:0/908868168 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684369677 0 0) 0x7fc2680c7cc0 con 0x7fc268140a40 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 -- 172.21.15.37:0/908868168 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2680c7670 con 0x7fc26806daa0 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc26759e700 1 --2- 172.21.15.37:0/908868168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc26806daa0 0x7fc2680c0e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2680c7c30 tx=0x7fc2600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bad160ef2546827 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc265d9b700 1 -- 172.21.15.37:0/908868168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011630 con 0x7fc26806daa0 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc265d9b700 1 -- 172.21.15.37:0/908868168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260011790 con 0x7fc26806daa0 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.257+0000 7fc265d9b700 1 -- 172.21.15.37:0/908868168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011b30 con 0x7fc26806daa0 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 -- 172.21.15.37:0/908868168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc26806daa0 msgr2=0x7fc2680c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/908868168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc26806daa0 0x7fc2680c0e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2680c7c30 tx=0x7fc2600091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 -- 172.21.15.37:0/908868168 shutdown_connections 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/908868168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc26806daa0 0x7fc2680c0e00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/908868168 >> v2:172.21.15.83:3300/0 conn(0x7fc268140e10 0x7fc26806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 -- 172.21.15.37:0/908868168 >> 172.21.15.37:0/908868168 conn(0x7fc268068130 msgr2=0x7fc2680cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 -- 172.21.15.37:0/908868168 shutdown_connections 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.258+0000 7fc26c9fe700 1 -- 172.21.15.37:0/908868168 wait complete. 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.259+0000 7fc26c9fe700 1 Processor -- start 2023-10-06T04:17:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.259+0000 7fc26c9fe700 1 -- start start 2023-10-06T04:17:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc26806daa0 0x7fc2680ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 0x7fc26813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc268140120 con 0x7fc268140e10 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ae6a0 con 0x7fc268140a40 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26c9fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ad580 con 0x7fc26806daa0 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49862/0 (socket says 172.21.15.37:49862) 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26759e700 1 -- 172.21.15.37:0/661099926 learned_addr learned my addr 172.21.15.37:0/661099926 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc266d9d700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc26806daa0 0x7fc2680ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26659c700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 0x7fc26813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.260+0000 7fc26759e700 1 -- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc26806daa0 msgr2=0x7fc2680ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26759e700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc26806daa0 0x7fc2680ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26759e700 1 -- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 msgr2=0x7fc26813fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26759e700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 0x7fc26813fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26759e700 1 -- 172.21.15.37:0/661099926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260009420 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26659c700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 0x7fc26813fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26759e700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc26806d0e0 tx=0x7fc260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600195c0 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260019720 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2680ac970 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260019ae0 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.261+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2680acf30 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.262+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26804c3c0 con 0x7fc268140e10 2023-10-06T04:17:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.262+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2600253f0 con 0x7fc268140e10 2023-10-06T04:17:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.263+0000 7fc25effd700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.263+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc260086150 con 0x7fc268140e10 2023-10-06T04:17:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.263+0000 7fc266d9d700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.263+0000 7fc266d9d700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 0x7fc2480693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc258001560 tx=0x7fc258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.267+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc260053260 con 0x7fc268140e10 2023-10-06T04:17:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.465+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2680ccc80 con 0x7fc268140e10 2023-10-06T04:17:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.466+0000 7fc25effd700 1 -- 172.21.15.37:0/661099926 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fc260056880 con 0x7fc268140e10 2023-10-06T04:17:32.468 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:32.468 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 msgr2=0x7fc2480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 0x7fc2480693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc258001560 tx=0x7fc258009040 comp rx=0 tx=0).stop 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 msgr2=0x7fc2680ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc26806d0e0 tx=0x7fc260017000 comp rx=0 tx=0).stop 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 shutdown_connections 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268140e10 0x7fc2680ae160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc26806daa0 0x7fc2680ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc248066f30 0x7fc2480693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 --2- 172.21.15.37:0/661099926 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc268140a40 0x7fc26813fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 >> 172.21.15.37:0/661099926 conn(0x7fc268068130 msgr2=0x7fc26806b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 shutdown_connections 2023-10-06T04:17:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.468+0000 7fc26c9fe700 1 -- 172.21.15.37:0/661099926 wait complete. 2023-10-06T04:17:32.482 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:17:32.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.600+0000 7fc30a895700 1 Processor -- start 2023-10-06T04:17:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.600+0000 7fc30a895700 1 -- start start 2023-10-06T04:17:32.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc30a895700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc304150e60 0x7fc3040aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc30a895700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc304157a10 con 0x7fc3040b0170 2023-10-06T04:17:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc30a895700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc304156ba0 con 0x7fc304150a90 2023-10-06T04:17:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc30a895700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30406efd0 con 0x7fc304150e60 2023-10-06T04:17:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc308e32700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3040b0170 0x7fc30415a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53982/0 (socket says 172.21.15.37:53982) 2023-10-06T04:17:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc308e32700 1 -- 172.21.15.37:0/3869750226 learned_addr learned my addr 172.21.15.37:0/3869750226 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc304150e60 0x7fc3040aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546310687 0 0) 0x7fc304157a10 con 0x7fc3040b0170 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ec003570 con 0x7fc3040b0170 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609481302 0 0) 0x7fc304156ba0 con 0x7fc304150a90 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304157a10 con 0x7fc304150a90 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075726663 0 0) 0x7fc2ec003570 con 0x7fc3040b0170 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc304150e60 msgr2=0x7fc3040aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc304150e60 0x7fc3040aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 >> v1:172.21.15.83:6789/0 conn(0x7fc304150a90 legacy=0x7fc30406f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304156e00 con 0x7fc3040b0170 2023-10-06T04:17:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fc2fc0017f0 con 0x7fc3040b0170 2023-10-06T04:17:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 >> v1:172.21.15.37:6789/0 conn(0x7fc3040b0170 legacy=0x7fc30415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec003c20 0x7fc2ec004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec004810 0x7fc2ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2ec0051c0 0x7fc2ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30406efd0 con 0x7fc2ec004810 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec00c020 con 0x7fc2ec003c20 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec00c1e0 con 0x7fc2ec0051c0 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.601+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc304150e60 0x7fc3040aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec004810 0x7fc2ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc303fff700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec003c20 0x7fc2ec004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc308e32700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2ec0051c0 0x7fc2ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 -- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2ec0051c0 msgr2=0x7fc2ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc2ec0051c0 0x7fc2ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 -- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec003c20 msgr2=0x7fc2ec004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec003c20 0x7fc2ec004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 -- 172.21.15.37:0/3869750226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec003570 con 0x7fc2ec004810 2023-10-06T04:17:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc3037fe700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec004810 0x7fc2ec004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3040697c0 tx=0x7fc2f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dc2038b62249ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400e6e0 con 0x7fc2ec004810 2023-10-06T04:17:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400e840 con 0x7fc2ec004810 2023-10-06T04:17:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.602+0000 7fc302ffd700 1 -- 172.21.15.37:0/3869750226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400ec00 con 0x7fc2ec004810 2023-10-06T04:17:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 -- 172.21.15.37:0/3869750226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec004810 msgr2=0x7fc2ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 --2- 172.21.15.37:0/3869750226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec004810 0x7fc2ec004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3040697c0 tx=0x7fc2f40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc308e32700 1 -- 172.21.15.37:0/3869750226 reap_dead start 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 -- 172.21.15.37:0/3869750226 shutdown_connections 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 -- 172.21.15.37:0/3869750226 >> 172.21.15.37:0/3869750226 conn(0x7fc304068770 msgr2=0x7fc304068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 -- 172.21.15.37:0/3869750226 shutdown_connections 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.603+0000 7fc30a895700 1 -- 172.21.15.37:0/3869750226 wait complete. 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.604+0000 7fc30a895700 1 Processor -- start 2023-10-06T04:17:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.604+0000 7fc30a895700 1 -- start start 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec004810 0x7fc3040ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3040a9940 0x7fc3041581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040aaaf0 con 0x7fc30414af70 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30414b920 con 0x7fc2ec004810 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc30a895700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040ac5c0 con 0x7fc3040a9940 2023-10-06T04:17:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49872/0 (socket says 172.21.15.37:49872) 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 -- 172.21.15.37:0/2825235989 learned_addr learned my addr 172.21.15.37:0/2825235989 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc303fff700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec004810 0x7fc3040ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc3037fe700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3040a9940 0x7fc3041581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 -- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3040a9940 msgr2=0x7fc3041581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3040a9940 0x7fc3041581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 -- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec004810 msgr2=0x7fc3040ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec004810 0x7fc3040ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 -- 172.21.15.37:0/2825235989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040a9ee0 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc308e32700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc000f80 tx=0x7fc2fc002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00ad40 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.605+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0133f0 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.606+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040aa1c0 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.606+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0137b0 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.606+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040aa780 con 0x7fc30414af70 2023-10-06T04:17:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.607+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc304063410 con 0x7fc30414af70 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.607+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2fc013ba0 con 0x7fc30414af70 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.607+0000 7fc2ebfff700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 0x7fc2f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.607+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2fc0852e0 con 0x7fc30414af70 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.607+0000 7fc303fff700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 0x7fc2f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.608+0000 7fc303fff700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 0x7fc2f00693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f60 tx=0x7fc2f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.612+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2fc0523f0 con 0x7fc30414af70 2023-10-06T04:17:32.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.850+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc304157d80 con 0x7fc30414af70 2023-10-06T04:17:32.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.851+0000 7fc2ebfff700 1 -- 172.21.15.37:0/2825235989 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fc2fc055a10 con 0x7fc30414af70 2023-10-06T04:17:32.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:32.852 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 msgr2=0x7fc2f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 0x7fc2f00693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f60 tx=0x7fc2f8009040 comp rx=0 tx=0).stop 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 msgr2=0x7fc30414b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc000f80 tx=0x7fc2fc002190 comp rx=0 tx=0).stop 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 shutdown_connections 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30414af70 0x7fc30414b3e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc2f0066f30 0x7fc2f00693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2ec004810 0x7fc3040ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 --2- 172.21.15.37:0/2825235989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3040a9940 0x7fc3041581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 >> 172.21.15.37:0/2825235989 conn(0x7fc304068770 msgr2=0x7fc3040af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 shutdown_connections 2023-10-06T04:17:32.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.853+0000 7fc30a895700 1 -- 172.21.15.37:0/2825235989 wait complete. 2023-10-06T04:17:32.856 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:32.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.984+0000 7fd2336f7700 1 Processor -- start 2023-10-06T04:17:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.984+0000 7fd2336f7700 1 -- start start 2023-10-06T04:17:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd2336f7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd22c1598a0 0x7fd22c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd2336f7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0cd480 con 0x7fd22c0b0140 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd2336f7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0b0c70 con 0x7fd22c159c70 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd2336f7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0b1230 con 0x7fd22c1598a0 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd231493700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd22c1598a0 0x7fd22c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd231c94700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd22c0b0140 0x7fd22c067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53998/0 (socket says 172.21.15.37:53998) 2023-10-06T04:17:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.985+0000 7fd231c94700 1 -- 172.21.15.37:0/258397424 learned_addr learned my addr 172.21.15.37:0/258397424 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:32.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd231493700 1 -- 172.21.15.37:0/258397424 >> v1:172.21.15.83:6789/0 conn(0x7fd22c159c70 legacy=0x7fd22c0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd231493700 1 -- 172.21.15.37:0/258397424 >> v1:172.21.15.37:6789/0 conn(0x7fd22c0b0140 legacy=0x7fd22c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd231493700 1 -- 172.21.15.37:0/258397424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0b0f50 con 0x7fd22c1598a0 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd223fff700 1 -- 172.21.15.37:0/258397424 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376675707 0 0) 0x7fd22c0cd480 con 0x7fd22c0b0140 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd231493700 1 --2- 172.21.15.37:0/258397424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c1598a0 0x7fd22c06e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0098e0 tx=0x7fd21c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fa666b6accabc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd223fff700 1 -- 172.21.15.37:0/258397424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c009e80 con 0x7fd22c1598a0 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd223fff700 1 -- 172.21.15.37:0/258397424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00b820 con 0x7fd22c1598a0 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd223fff700 1 -- 172.21.15.37:0/258397424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00bba0 con 0x7fd22c1598a0 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd2336f7700 1 -- 172.21.15.37:0/258397424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c1598a0 msgr2=0x7fd22c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd2336f7700 1 --2- 172.21.15.37:0/258397424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c1598a0 0x7fd22c06e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0098e0 tx=0x7fd21c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd2336f7700 1 -- 172.21.15.37:0/258397424 shutdown_connections 2023-10-06T04:17:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.986+0000 7fd2336f7700 1 --2- 172.21.15.37:0/258397424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c1598a0 0x7fd22c06e770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.987+0000 7fd2336f7700 1 -- 172.21.15.37:0/258397424 >> 172.21.15.37:0/258397424 conn(0x7fd22c06a810 msgr2=0x7fd22c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.987+0000 7fd2336f7700 1 -- 172.21.15.37:0/258397424 shutdown_connections 2023-10-06T04:17:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.987+0000 7fd2336f7700 1 -- 172.21.15.37:0/258397424 wait complete. 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.988+0000 7fd2336f7700 1 Processor -- start 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.988+0000 7fd2336f7700 1 -- start start 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd22c1598a0 0x7fd22c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd22c159c70 0x7fd22c0aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c15b1b0 con 0x7fd22c0b0140 2023-10-06T04:17:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c15a110 con 0x7fd22c1598a0 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c15a3f0 con 0x7fd22c159c70 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49894/0 (socket says 172.21.15.37:49894) 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 -- 172.21.15.37:0/557987957 learned_addr learned my addr 172.21.15.37:0/557987957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 -- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd22c159c70 msgr2=0x7fd22c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd22c159c70 0x7fd22c0aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 -- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd22c1598a0 msgr2=0x7fd22c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd22c1598a0 0x7fd22c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 -- 172.21.15.37:0/557987957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c009420 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd231493700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0030c0 tx=0x7fd21c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00ba10 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c020070 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c15a6d0 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c01b6a0 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.989+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c15ac90 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.990+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c0b3050 con 0x7fd22c0b0140 2023-10-06T04:17:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.991+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd21c022030 con 0x7fd22c0b0140 2023-10-06T04:17:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.991+0000 7fd2217fa700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 0x7fd2100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.991+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd21c0866b0 con 0x7fd22c0b0140 2023-10-06T04:17:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.991+0000 7fd230c92700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 0x7fd2100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.992+0000 7fd230c92700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 0x7fd2100693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0b2f60 tx=0x7fd228006c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:32.995+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd21c0537c0 con 0x7fd22c0b0140 2023-10-06T04:17:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.234+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd22c0b3050 con 0x7fd22c0b0140 2023-10-06T04:17:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.235+0000 7fd2217fa700 1 -- 172.21.15.37:0/557987957 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fd21c056de0 con 0x7fd22c0b0140 2023-10-06T04:17:33.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3403398063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3403398063},{"type":"v1","addr":"172.21.15.83:6836","nonce":3403398063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3829187078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3829187078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3829187078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1739554217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1739554217},{"type":"v1","addr":"172.21.15.37:6835","nonce":1739554217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:16:56.046938+0000","modified":"2023-10-06T04:16:59.691089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/4051514418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":4051514418},{"type":"v1","addr":"172.21.15.83:6837","nonce":4051514418}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 msgr2=0x7fd2100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 0x7fd2100693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0b2f60 tx=0x7fd228006c40 comp rx=0 tx=0).stop 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 msgr2=0x7fd22c14b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0030c0 tx=0x7fd21c016000 comp rx=0 tx=0).stop 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 shutdown_connections 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd22c159c70 0x7fd22c0aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22c0b0140 0x7fd22c14b020 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd210066f30 0x7fd2100693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 --2- 172.21.15.37:0/557987957 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd22c1598a0 0x7fd22c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 >> 172.21.15.37:0/557987957 conn(0x7fd22c06a810 msgr2=0x7fd22c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 shutdown_connections 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.237+0000 7fd2336f7700 1 -- 172.21.15.37:0/557987957 wait complete. 2023-10-06T04:17:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-10-06T04:17:33.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.367+0000 7f4df5cc9700 1 Processor -- start 2023-10-06T04:17:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.367+0000 7f4df5cc9700 1 -- start start 2023-10-06T04:17:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4df5cc9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4df00ccac0 0x7f4df006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4df5cc9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00ccf70 con 0x7f4df00b3d80 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4df5cc9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00cd250 con 0x7f4df00b4150 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4df5cc9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00cd530 con 0x7f4df00ccac0 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4def7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4df00b3d80 0x7f4df00cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54004/0 (socket says 172.21.15.37:54004) 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4def7fe700 1 -- 172.21.15.37:0/1306328366 learned_addr learned my addr 172.21.15.37:0/1306328366 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.368+0000 7f4deeffd700 1 --2- 172.21.15.37:0/1306328366 >> v2:172.21.15.37:3300/0 conn(0x7f4df00ccac0 0x7f4df006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4dee7fc700 1 -- 172.21.15.37:0/1306328366 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583923236 0 0) 0x7f4df00ccf70 con 0x7f4df00b3d80 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4dee7fc700 1 -- 172.21.15.37:0/1306328366 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003570 con 0x7f4df00b3d80 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4deeffd700 1 -- 172.21.15.37:0/1306328366 >> v1:172.21.15.83:6789/0 conn(0x7f4df00b4150 legacy=0x7f4df0158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4deeffd700 1 -- 172.21.15.37:0/1306328366 >> v1:172.21.15.37:6789/0 conn(0x7f4df00b3d80 legacy=0x7f4df00cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4deeffd700 1 -- 172.21.15.37:0/1306328366 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00cd810 con 0x7f4df00ccac0 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4deeffd700 1 --2- 172.21.15.37:0/1306328366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df006b9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4de40098e0 tx=0x7f4de40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c52ad011e6f3ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4dee7fc700 1 -- 172.21.15.37:0/1306328366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400b640 con 0x7f4df00ccac0 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4dee7fc700 1 -- 172.21.15.37:0/1306328366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de400b7a0 con 0x7f4df00ccac0 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.369+0000 7f4dee7fc700 1 -- 172.21.15.37:0/1306328366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400bb40 con 0x7f4df00ccac0 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 -- 172.21.15.37:0/1306328366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 msgr2=0x7f4df006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/1306328366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df006b9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4de40098e0 tx=0x7f4de40091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 -- 172.21.15.37:0/1306328366 shutdown_connections 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/1306328366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df006b9d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 -- 172.21.15.37:0/1306328366 >> 172.21.15.37:0/1306328366 conn(0x7f4df00ce470 msgr2=0x7f4df00ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 -- 172.21.15.37:0/1306328366 shutdown_connections 2023-10-06T04:17:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.370+0000 7f4df5cc9700 1 -- 172.21.15.37:0/1306328366 wait complete. 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.371+0000 7f4df5cc9700 1 Processor -- start 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.371+0000 7f4df5cc9700 1 -- start start 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4df00b3d80 0x7f4df01511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4df00b4150 0x7f4df00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0154300 con 0x7f4df00ccac0 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01545e0 con 0x7f4df00b3d80 2023-10-06T04:17:33.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4df5cc9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01548c0 con 0x7f4df00b4150 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49900/0 (socket says 172.21.15.37:49900) 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4def7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4df00b3d80 0x7f4df01511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 -- 172.21.15.37:0/704134267 learned_addr learned my addr 172.21.15.37:0/704134267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deeffd700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4df00b4150 0x7f4df00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 -- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4df00b4150 msgr2=0x7f4df00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4df00b4150 0x7f4df00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 -- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4df00b3d80 msgr2=0x7f4df01511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4df00b3d80 0x7f4df01511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 -- 172.21.15.37:0/704134267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009420 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4deffff700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c910 tx=0x7f4de80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.372+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8012630 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.373+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8012790 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.373+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0154ba0 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.373+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8012b50 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.373+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0156770 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.373+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df01550c0 con 0x7f4df00ccac0 2023-10-06T04:17:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.374+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de801b450 con 0x7f4df00ccac0 2023-10-06T04:17:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.374+0000 7f4dd77fe700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.374+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4de80847e0 con 0x7f4df00ccac0 2023-10-06T04:17:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.375+0000 7f4def7fe700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.375+0000 7f4def7fe700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 0x7f4ddc0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4df00c6540 tx=0x7f4de0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.379+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df01550c0 con 0x7f4df00ccac0 2023-10-06T04:17:33.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.572+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df01550c0 con 0x7f4df00ccac0 2023-10-06T04:17:33.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.573+0000 7f4dd77fe700 1 -- 172.21.15.37:0/704134267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f4df01550c0 con 0x7f4df00ccac0 2023-10-06T04:17:33.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:33.575 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:16:57.650280+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:16:53.780037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:16:55.019362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:33.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 msgr2=0x7f4ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 0x7f4ddc0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4df00c6540 tx=0x7f4de0009040 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 msgr2=0x7f4df01687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c910 tx=0x7f4de80016f0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 shutdown_connections 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df00ccac0 0x7f4df01687e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4df00b3d80 0x7f4df01511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 --2- 172.21.15.37:0/704134267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4df00b4150 0x7f4df00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 >> 172.21.15.37:0/704134267 conn(0x7f4df00ce470 msgr2=0x7f4df00b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 shutdown_connections 2023-10-06T04:17:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.575+0000 7f4df5cc9700 1 -- 172.21.15.37:0/704134267 wait complete. 2023-10-06T04:17:33.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:17:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.707+0000 7f03d3125700 1 Processor -- start 2023-10-06T04:17:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.707+0000 7f03d3125700 1 -- start start 2023-10-06T04:17:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f03cc0cd0b0 0x7f03cc15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0cd480 0x7f03cc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03cc0afed0 0x7f03cc0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0cb8d0 con 0x7f03cc0afed0 2023-10-06T04:17:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0ce7c0 con 0x7f03cc0cd0b0 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d3125700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0ceaa0 con 0x7f03cc0cd480 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03cc0afed0 0x7f03cc0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03cc0afed0 0x7f03cc0b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49906/0 (socket says 172.21.15.37:49906) 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 -- 172.21.15.37:0/2568762453 learned_addr learned my addr 172.21.15.37:0/2568762453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2123700 1 --2- 172.21.15.37:0/2568762453 >> v2:172.21.15.83:3300/0 conn(0x7f03cc0cd0b0 0x7f03cc15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d1922700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0cd480 0x7f03cc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 -- 172.21.15.37:0/2568762453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0cd480 msgr2=0x7f03cc0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0cd480 0x7f03cc0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 -- 172.21.15.37:0/2568762453 >> v2:172.21.15.83:3300/0 conn(0x7f03cc0cd0b0 msgr2=0x7f03cc15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 --2- 172.21.15.37:0/2568762453 >> v2:172.21.15.83:3300/0 conn(0x7f03cc0cd0b0 0x7f03cc15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.708+0000 7f03d2924700 1 -- 172.21.15.37:0/2568762453 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0ced80 con 0x7f03cc0afed0 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d2924700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0afed0 0x7f03cc0b1950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03cc067ee0 tx=0x7f03bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e03afc8f0070851 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d1121700 1 -- 172.21.15.37:0/2568762453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00b8f0 con 0x7f03cc0afed0 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d1121700 1 -- 172.21.15.37:0/2568762453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00ba50 con 0x7f03cc0afed0 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d1121700 1 -- 172.21.15.37:0/2568762453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00bdf0 con 0x7f03cc0afed0 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 -- 172.21.15.37:0/2568762453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0afed0 msgr2=0x7f03cc0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0afed0 0x7f03cc0b1950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03cc067ee0 tx=0x7f03bc009250 comp rx=0 tx=0).stop 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 -- 172.21.15.37:0/2568762453 shutdown_connections 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0afed0 0x7f03cc0b1950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 --2- 172.21.15.37:0/2568762453 >> v2:172.21.15.83:3300/0 conn(0x7f03cc0cd0b0 0x7f03cc15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 --2- 172.21.15.37:0/2568762453 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0cd480 0x7f03cc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 -- 172.21.15.37:0/2568762453 >> 172.21.15.37:0/2568762453 conn(0x7f03cc06ed90 msgr2=0x7f03cc06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.709+0000 7f03d3125700 1 -- 172.21.15.37:0/2568762453 shutdown_connections 2023-10-06T04:17:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.710+0000 7f03d3125700 1 -- 172.21.15.37:0/2568762453 wait complete. 2023-10-06T04:17:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 Processor -- start 2023-10-06T04:17:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 -- start start 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0afed0 0x7f03cc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03cc0cd0b0 0x7f03cc168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0c89b0 con 0x7f03cc0cd480 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc169150 con 0x7f03cc0cd0b0 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d3125700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0c7da0 con 0x7f03cc0afed0 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d2924700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d2924700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49908/0 (socket says 172.21.15.37:49908) 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d2924700 1 -- 172.21.15.37:0/1352722188 learned_addr learned my addr 172.21.15.37:0/1352722188 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d2123700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0afed0 0x7f03cc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.711+0000 7f03d1922700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03cc0cd0b0 0x7f03cc168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 -- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0afed0 msgr2=0x7f03cc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0afed0 0x7f03cc0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 -- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03cc0cd0b0 msgr2=0x7f03cc168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03cc0cd0b0 0x7f03cc168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 -- 172.21.15.37:0/1352722188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0094f0 con 0x7f03cc0cd480 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d2924700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f03cc069600 tx=0x7f03bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011e80 con 0x7f03cc0cd480 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc01a630 con 0x7f03cc0cd480 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc0c8080 con 0x7f03cc0cd480 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc01a9f0 con 0x7f03cc0cd480 2023-10-06T04:17:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.712+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc0c8640 con 0x7f03cc0cd480 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.713+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc04c3c0 con 0x7f03cc0cd480 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.713+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03bc02e430 con 0x7f03cc0cd480 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.714+0000 7f03ca7fc700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.714+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03bc086250 con 0x7f03cc0cd480 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.714+0000 7f03d2123700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.715+0000 7f03d2123700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 0x7f03b80693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009fd0 tx=0x7f03c4009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:33.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.718+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03bc053360 con 0x7f03cc0cd480 2023-10-06T04:17:33.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.963+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f03cc0cf060 con 0x7f03cc0cd480 2023-10-06T04:17:33.965 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:17:33.963+0000 7f8a6e8c5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:17:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.967+0000 7f03ca7fc700 1 -- 172.21.15.37:0/1352722188 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f03bc056980 con 0x7f03cc0cd480 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 msgr2=0x7f03b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 0x7f03b80693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009fd0 tx=0x7f03c4009880 comp rx=0 tx=0).stop 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 msgr2=0x7f03cc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f03cc069600 tx=0x7f03bc017000 comp rx=0 tx=0).stop 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 shutdown_connections 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc0cd480 0x7f03cc0c7550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f03cc0afed0 0x7f03cc0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f03b8066f30 0x7f03b80693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 --2- 172.21.15.37:0/1352722188 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03cc0cd0b0 0x7f03cc168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 >> 172.21.15.37:0/1352722188 conn(0x7f03cc06ed90 msgr2=0x7f03cc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 shutdown_connections 2023-10-06T04:17:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:33.969+0000 7f03d3125700 1 -- 172.21.15.37:0/1352722188 wait complete. 2023-10-06T04:17:33.972 INFO:tasks.ceph.mds.d.smithi083.stderr: -1750> 2023-10-06T04:17:01.728+0000 7f9a1978a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:17:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:17:33.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:17:33.996 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:17:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.102+0000 7f0a91e8f700 1 Processor -- start 2023-10-06T04:17:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.102+0000 7f0a91e8f700 1 -- start start 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a91e8f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a8c0d09f0 0x7f0a8c159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a91e8f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0b51a0 con 0x7f0a8c1539c0 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a91e8f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0b5ff0 con 0x7f0a8c153d90 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a91e8f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0b53e0 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a9168e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a8c0d09f0 0x7f0a8c159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a90e8d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a8c1539c0 0x7f0a8c0b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54018/0 (socket says 172.21.15.37:54018) 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a90e8d700 1 -- 172.21.15.37:0/4107443223 learned_addr learned my addr 172.21.15.37:0/4107443223 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a9168e700 1 -- 172.21.15.37:0/4107443223 >> v1:172.21.15.83:6789/0 conn(0x7f0a8c153d90 legacy=0x7f0a8c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a9168e700 1 -- 172.21.15.37:0/4107443223 >> v1:172.21.15.37:6789/0 conn(0x7f0a8c1539c0 legacy=0x7f0a8c0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a9168e700 1 -- 172.21.15.37:0/4107443223 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0b56c0 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.103+0000 7f0a8b7fe700 1 -- 172.21.15.37:0/4107443223 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565528885 0 0) 0x7f0a80001110 con 0x7f0a8c1539c0 2023-10-06T04:17:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a9168e700 1 --2- 172.21.15.37:0/4107443223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0d09f0 0x7f0a8c159b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009e60 tx=0x7f0a84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71a1669a706362f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a8b7fe700 1 -- 172.21.15.37:0/4107443223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400e070 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a8b7fe700 1 -- 172.21.15.37:0/4107443223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400bbf0 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a8b7fe700 1 -- 172.21.15.37:0/4107443223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84012430 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 -- 172.21.15.37:0/4107443223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0d09f0 msgr2=0x7f0a8c159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/4107443223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0d09f0 0x7f0a8c159b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009e60 tx=0x7f0a84009780 comp rx=0 tx=0).stop 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 -- 172.21.15.37:0/4107443223 shutdown_connections 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/4107443223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0d09f0 0x7f0a8c159b00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 -- 172.21.15.37:0/4107443223 >> 172.21.15.37:0/4107443223 conn(0x7f0a8c06ed90 msgr2=0x7f0a8c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 -- 172.21.15.37:0/4107443223 shutdown_connections 2023-10-06T04:17:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.104+0000 7f0a91e8f700 1 -- 172.21.15.37:0/4107443223 wait complete. 2023-10-06T04:17:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.105+0000 7f0a91e8f700 1 Processor -- start 2023-10-06T04:17:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 -- start start 2023-10-06T04:17:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a8c0d09f0 0x7f0a8c169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a8c153d90 0x7f0a8c148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c14d0b0 con 0x7f0a8c1539c0 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c149030 con 0x7f0a8c153d90 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.106+0000 7f0a91e8f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c14ca60 con 0x7f0a8c0d09f0 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49918/0 (socket says 172.21.15.37:49918) 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 -- 172.21.15.37:0/3438254836 learned_addr learned my addr 172.21.15.37:0/3438254836 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a90e8d700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a8c0d09f0 0x7f0a8c169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a9168e700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a8c153d90 0x7f0a8c148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 -- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a8c0d09f0 msgr2=0x7f0a8c169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a8c0d09f0 0x7f0a8c169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 -- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a8c153d90 msgr2=0x7f0a8c148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a8c153d90 0x7f0a8c148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 -- 172.21.15.37:0/3438254836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84009a20 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a8bfff700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800b5e0 tx=0x7f0a780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800f510 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800f6b0 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c14cd40 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800fa70 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.107+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c148c90 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.108+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c15a710 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.109+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a7801a400 con 0x7f0a8c1539c0 2023-10-06T04:17:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.109+0000 7f0a88ff9700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.109+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0a78084230 con 0x7f0a8c1539c0 2023-10-06T04:17:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.109+0000 7f0a90e8d700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.110+0000 7f0a90e8d700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 0x7f0a700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a800018a0 tx=0x7f0a80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.113+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a78051370 con 0x7f0a8c1539c0 2023-10-06T04:17:34.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.355+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a8c04c3c0 con 0x7f0a8c1539c0 2023-10-06T04:17:34.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.967+0000 7f0a88ff9700 1 -- 172.21.15.37:0/3438254836 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a78054990 con 0x7f0a8c1539c0 2023-10-06T04:17:34.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 msgr2=0x7f0a700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 0x7f0a700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a800018a0 tx=0x7f0a80009040 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 msgr2=0x7f0a8c147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800b5e0 tx=0x7f0a780090f0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 shutdown_connections 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0a70066f30 0x7f0a700693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a8c153d90 0x7f0a8c148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0a8c0d09f0 0x7f0a8c169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 --2- 172.21.15.37:0/3438254836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c1539c0 0x7f0a8c147120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 >> 172.21.15.37:0/3438254836 conn(0x7f0a8c06ed90 msgr2=0x7f0a8c0b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 shutdown_connections 2023-10-06T04:17:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:34.970+0000 7f0a91e8f700 1 -- 172.21.15.37:0/3438254836 wait complete. 2023-10-06T04:17:34.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:17:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.110+0000 7f07f095b700 1 Processor -- start 2023-10-06T04:17:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.110+0000 7f07f095b700 1 -- start start 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.111+0000 7f07f095b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.111+0000 7f07f095b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07ec0cd730 0x7f07ec0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.111+0000 7f07f095b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0cf500 con 0x7f07ec0ceb50 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.111+0000 7f07f095b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec0cbb00 con 0x7f07ec0cd730 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.111+0000 7f07f095b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0cdc50 con 0x7f07ec159da0 2023-10-06T04:17:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ead9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07ec0cd730 0x7f07ec0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:55640/0 (socket says 172.21.15.37:55640) 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 -- 172.21.15.37:0/1246929609 learned_addr learned my addr 172.21.15.37:0/1246929609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 -- 172.21.15.37:0/1246929609 >> v2:172.21.15.83:3300/0 conn(0x7f07ec0cd730 msgr2=0x7f07ec0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 --2- 172.21.15.37:0/1246929609 >> v2:172.21.15.83:3300/0 conn(0x7f07ec0cd730 0x7f07ec0cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 -- 172.21.15.37:0/1246929609 >> v1:172.21.15.83:6789/0 conn(0x7f07ec0ceb50 legacy=0x7f07ec0cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 -- 172.21.15.37:0/1246929609 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0cdf30 con 0x7f07ec159da0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07e959a700 1 -- 172.21.15.37:0/1246929609 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609578293 0 0) 0x7f07ec0cf500 con 0x7f07ec0ceb50 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07ea59c700 1 --2- 172.21.15.37:0/1246929609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009f70 tx=0x7f07dc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d81ad1f9b1370e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07e959a700 1 -- 172.21.15.37:0/1246929609 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00e070 con 0x7f07ec159da0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07e959a700 1 -- 172.21.15.37:0/1246929609 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00ba20 con 0x7f07ec159da0 2023-10-06T04:17:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.112+0000 7f07e959a700 1 -- 172.21.15.37:0/1246929609 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0092e0 con 0x7f07ec159da0 2023-10-06T04:17:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 -- 172.21.15.37:0/1246929609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 msgr2=0x7f07ec0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 --2- 172.21.15.37:0/1246929609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009f70 tx=0x7f07dc009840 comp rx=0 tx=0).stop 2023-10-06T04:17:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 -- 172.21.15.37:0/1246929609 shutdown_connections 2023-10-06T04:17:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 --2- 172.21.15.37:0/1246929609 >> v2:172.21.15.83:3300/0 conn(0x7f07ec0cd730 0x7f07ec0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 --2- 172.21.15.37:0/1246929609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c5410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 -- 172.21.15.37:0/1246929609 >> 172.21.15.37:0/1246929609 conn(0x7f07ec099aa0 msgr2=0x7f07ec06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 -- 172.21.15.37:0/1246929609 shutdown_connections 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.113+0000 7f07f095b700 1 -- 172.21.15.37:0/1246929609 wait complete. 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.114+0000 7f07f095b700 1 Processor -- start 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.114+0000 7f07f095b700 1 -- start start 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec0cd730 0x7f07ec140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0b1a30 con 0x7f07ec0ceb50 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0b1d10 con 0x7f07ec0cd730 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07f095b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec0b1ff0 con 0x7f07ec159da0 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49928/0 (socket says 172.21.15.37:49928) 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 -- 172.21.15.37:0/1446833927 learned_addr learned my addr 172.21.15.37:0/1446833927 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07ea59c700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec0cd730 0x7f07ec140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07ead9d700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 -- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 msgr2=0x7f07ec0c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 -- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec0cd730 msgr2=0x7f07ec140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec0cd730 0x7f07ec140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.115+0000 7f07e9d9b700 1 -- 172.21.15.37:0/1446833927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009ae0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07e9d9b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c7e0 tx=0x7f07d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40105c0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4010740 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec0b22d0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4010b00 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.116+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec141150 con 0x7f07ec0ceb50 2023-10-06T04:17:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.117+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec0b1b70 con 0x7f07ec0ceb50 2023-10-06T04:17:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.117+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07d401b3b0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.118+0000 7f07e27fc700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.118+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f07d4083d10 con 0x7f07ec0ceb50 2023-10-06T04:17:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.118+0000 7f07ea59c700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.118+0000 7f07ea59c700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 0x7f07cc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009880 tx=0x7f07dc018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.122+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07ec0b1b70 con 0x7f07ec0ceb50 2023-10-06T04:17:35.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.315+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07ec0ca6b0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.975+0000 7f07e27fc700 1 -- 172.21.15.37:0/1446833927 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f07ec0ca6b0 con 0x7f07ec0ceb50 2023-10-06T04:17:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.980+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 msgr2=0x7f07cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.980+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 0x7f07cc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009880 tx=0x7f07dc018000 comp rx=0 tx=0).stop 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.980+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 msgr2=0x7f07ec0c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.980+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c7e0 tx=0x7f07d4007df0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 shutdown_connections 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07ec159da0 0x7f07ec0c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07ec0cd730 0x7f07ec140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 --2- 172.21.15.37:0/1446833927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07ec0ceb50 0x7f07ec0c7720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:35.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 >> 172.21.15.37:0/1446833927 conn(0x7f07ec099aa0 msgr2=0x7f07ec155660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:35.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.981+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 shutdown_connections 2023-10-06T04:17:35.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:35.982+0000 7f07f095b700 1 -- 172.21.15.37:0/1446833927 wait complete. 2023-10-06T04:17:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:17:36.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:17:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.133+0000 7f3bbd9e8700 1 Processor -- start 2023-10-06T04:17:36.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.133+0000 7f3bbd9e8700 1 -- start start 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bbd9e8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bb8159da0 0x7f3bb80c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bbd9e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bbd9e8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80cf500 con 0x7f3bb80ceb50 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bbd9e8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb80cbb00 con 0x7f3bb8159da0 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bbd9e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cdc50 con 0x7f3bb80cd730 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bb8159da0 0x7f3bb80c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb67fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3bb80ceb50 0x7f3bb80cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54022/0 (socket says 172.21.15.37:54022) 2023-10-06T04:17:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb67fc700 1 -- 172.21.15.37:0/1499973619 learned_addr learned my addr 172.21.15.37:0/1499973619 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb77fe700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 -- 172.21.15.37:0/1499973619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 msgr2=0x7f3bb80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 -- 172.21.15.37:0/1499973619 >> v1:172.21.15.37:6789/0 conn(0x7f3bb80ceb50 legacy=0x7f3bb80cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb5ffb700 1 -- 172.21.15.37:0/1499973619 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424557778 0 0) 0x7f3bb80cf500 con 0x7f3bb80ceb50 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 -- 172.21.15.37:0/1499973619 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80cdf30 con 0x7f3bb8159da0 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.134+0000 7f3bb6ffd700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb8159da0 0x7f3bb80c5410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00098d0 tx=0x7f3bb0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6244445856b6767a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bb5ffb700 1 -- 172.21.15.37:0/1499973619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0009e70 con 0x7f3bb8159da0 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bb5ffb700 1 -- 172.21.15.37:0/1499973619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0005c10 con 0x7f3bb8159da0 2023-10-06T04:17:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bb5ffb700 1 -- 172.21.15.37:0/1499973619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000b650 con 0x7f3bb8159da0 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/1499973619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb8159da0 msgr2=0x7f3bb80c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb8159da0 0x7f3bb80c5410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00098d0 tx=0x7f3bb0009120 comp rx=0 tx=0).stop 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/1499973619 shutdown_connections 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/1499973619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb8159da0 0x7f3bb80c5410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/1499973619 >> 172.21.15.37:0/1499973619 conn(0x7f3bb8099aa0 msgr2=0x7f3bb806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/1499973619 shutdown_connections 2023-10-06T04:17:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.135+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/1499973619 wait complete. 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.136+0000 7f3bbd9e8700 1 Processor -- start 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.136+0000 7f3bbd9e8700 1 -- start start 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 0x7f3bb80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80ad0c0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80adee0 con 0x7f3bb8159da0 2023-10-06T04:17:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bbd9e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80ad2d0 con 0x7f3bb80cd730 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49936/0 (socket says 172.21.15.37:49936) 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bb67fc700 1 -- 172.21.15.37:0/862706572 learned_addr learned my addr 172.21.15.37:0/862706572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bb6ffd700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.137+0000 7f3bb77fe700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 0x7f3bb80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 -- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 msgr2=0x7f3bb80ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 -- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 msgr2=0x7f3bb80ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 0x7f3bb80ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 -- 172.21.15.37:0/862706572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00093c0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb77fe700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 0x7f3bb80ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bb67fc700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c7e0 tx=0x7f3ba0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0005b30 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0005c90 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb80ad5b0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0007300 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.138+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80adb70 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.139+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb8063410 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.139+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ba00076b0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.140+0000 7f3baeffd700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.140+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f3ba0083ae0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.140+0000 7f3bb6ffd700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.141+0000 7f3bb6ffd700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009160 tx=0x7f3bb0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.144+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ba0050d10 con 0x7f3bb80ceb50 2023-10-06T04:17:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.337+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bb80ae020 con 0x7f3bb80ceb50 2023-10-06T04:17:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.979+0000 7f3baeffd700 1 -- 172.21.15.37:0/862706572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3ba00170d0 con 0x7f3bb80ceb50 2023-10-06T04:17:36.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.982+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 msgr2=0x7f3b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.982+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009160 tx=0x7f3bb0016000 comp rx=0 tx=0).stop 2023-10-06T04:17:36.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.982+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 msgr2=0x7f3bb81532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:36.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.982+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c7e0 tx=0x7f3ba0007df0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 shutdown_connections 2023-10-06T04:17:36.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bb8159da0 0x7f3bb80ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3bb80cd730 0x7f3bb80ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 --2- 172.21.15.37:0/862706572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bb80ceb50 0x7f3bb81532a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:36.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 >> 172.21.15.37:0/862706572 conn(0x7f3bb8099aa0 msgr2=0x7f3bb80ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:36.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 shutdown_connections 2023-10-06T04:17:36.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:36.984+0000 7f3bbd9e8700 1 -- 172.21.15.37:0/862706572 wait complete. 2023-10-06T04:17:36.986 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T04:17:37.001 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:17:37.002 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:17:37.002 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:17:37.002 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:17:37.002 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:17:37.003 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:17:37.003 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:17:37.003 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:17:37.003 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:17:37.003 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:17:37.003 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:17:37.003 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:17:37.004 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:17:37.004 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:17:37.004 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:17:37.004 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:17:37.012 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:17:37.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:17:37.013 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:17:37.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:17:37.014 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:17:37.015 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:17:37.015 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:17:37.015 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:17:37.055 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:17:37.055 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:37.055 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:17:37.056 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:37.057 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:17:37.058 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:37.058 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:17:37.058 DEBUG:teuthology.parallel:result is None 2023-10-06T04:17:37.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:17:37.132 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T04:17:37.132 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:17:37.137 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-10-06T04:17:37.137 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-10-06T04:17:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 Processor -- start 2023-10-06T04:17:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 -- start start 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 0x7f2de40b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de40b3430 0x7f2de4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de415a260 0x7f2de40b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40b6550 con 0x7f2de415a260 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40ab500 con 0x7f2de4159950 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.183+0000 7f2de95cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40b1cc0 con 0x7f2de40b3430 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de415a260 0x7f2de40b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de415a260 0x7f2de40b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52306/0 (socket says 172.21.15.37:52306) 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 -- 172.21.15.37:0/1943598881 learned_addr learned my addr 172.21.15.37:0/1943598881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de27fc700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de40b3430 0x7f2de4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de2ffd700 1 --2- 172.21.15.37:0/1943598881 >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 0x7f2de40b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 -- 172.21.15.37:0/1943598881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de40b3430 msgr2=0x7f2de4159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de40b3430 0x7f2de4159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 -- 172.21.15.37:0/1943598881 >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 msgr2=0x7f2de40b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 --2- 172.21.15.37:0/1943598881 >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 0x7f2de40b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 -- 172.21.15.37:0/1943598881 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40b0e30 con 0x7f2de415a260 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de2ffd700 1 --2- 172.21.15.37:0/1943598881 >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 0x7f2de40b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de37fe700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de415a260 0x7f2de40b4100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2de40895c0 tx=0x7f2ddc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0fc5dc78d27a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de1ffb700 1 -- 172.21.15.37:0/1943598881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00e070 con 0x7f2de415a260 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de1ffb700 1 -- 172.21.15.37:0/1943598881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00ba20 con 0x7f2de415a260 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.184+0000 7f2de1ffb700 1 -- 172.21.15.37:0/1943598881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0092e0 con 0x7f2de415a260 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 -- 172.21.15.37:0/1943598881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de415a260 msgr2=0x7f2de40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de415a260 0x7f2de40b4100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2de40895c0 tx=0x7f2ddc009840 comp rx=0 tx=0).stop 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 -- 172.21.15.37:0/1943598881 shutdown_connections 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de415a260 0x7f2de40b4100 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 --2- 172.21.15.37:0/1943598881 >> v2:172.21.15.83:3300/0 conn(0x7f2de4159950 0x7f2de40b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 --2- 172.21.15.37:0/1943598881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de40b3430 0x7f2de4159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 -- 172.21.15.37:0/1943598881 >> 172.21.15.37:0/1943598881 conn(0x7f2de4099a10 msgr2=0x7f2de406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 -- 172.21.15.37:0/1943598881 shutdown_connections 2023-10-06T04:17:37.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.185+0000 7f2de95cc700 1 -- 172.21.15.37:0/1943598881 wait complete. 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.186+0000 7f2de95cc700 1 Processor -- start 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.186+0000 7f2de95cc700 1 -- start start 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 0x7f2de4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 0x7f2de40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4154aa0 con 0x7f2de40b3430 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40cea20 con 0x7f2de4159950 2023-10-06T04:17:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de95cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de409a730 con 0x7f2de415a260 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52316/0 (socket says 172.21.15.37:52316) 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 -- 172.21.15.37:0/252193036 learned_addr learned my addr 172.21.15.37:0/252193036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de27fc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 0x7f2de4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de37fe700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 0x7f2de40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 -- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 msgr2=0x7f2de40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 0x7f2de40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 -- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 msgr2=0x7f2de4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 0x7f2de4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de2ffd700 1 -- 172.21.15.37:0/252193036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc009ae0 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de37fe700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 0x7f2de40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.187+0000 7f2de27fc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 0x7f2de4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2de2ffd700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e8d0 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400ee70 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400c5e0 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4154450 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400c980 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.188+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de4154160 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.189+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4063410 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.189+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2dd4013410 con 0x7f2de40b3430 2023-10-06T04:17:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.189+0000 7f2dcaffd700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.190+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2dd40841a0 con 0x7f2de40b3430 2023-10-06T04:17:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.190+0000 7f2de27fc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.190+0000 7f2de27fc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2de40aa8c0 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.194+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dd40515b0 con 0x7f2de40b3430 2023-10-06T04:17:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.403+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2de40b10b0 con 0x7f2de40b3430 2023-10-06T04:17:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.994+0000 7f2dcaffd700 1 -- 172.21.15.37:0/252193036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2dd4054bd0 con 0x7f2de40b3430 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 msgr2=0x7f2dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2de40aa8c0 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 msgr2=0x7f2de4152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e8d0 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 shutdown_connections 2023-10-06T04:17:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2de415a260 0x7f2de40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de40b3430 0x7f2de4152bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 --2- 172.21.15.37:0/252193036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2de4159950 0x7f2de4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 >> 172.21.15.37:0/252193036 conn(0x7f2de4099a10 msgr2=0x7f2de4068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 shutdown_connections 2023-10-06T04:17:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:37.997+0000 7f2de95cc700 1 -- 172.21.15.37:0/252193036 wait complete. 2023-10-06T04:17:38.001 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T04:17:38.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:17:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.134+0000 7faccefbf700 1 Processor -- start 2023-10-06T04:17:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.134+0000 7faccefbf700 1 -- start start 2023-10-06T04:17:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7faccefbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 0x7facc815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7faccefbf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80ae9f0 con 0x7facc80b6200 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7faccefbf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80adde0 con 0x7facc80ad800 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7faccefbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80ae0c0 con 0x7facc80b5e30 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7facc7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7facc80b6200 0x7facc80ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47888/0 (socket says 172.21.15.37:47888) 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7facc7fff700 1 -- 172.21.15.37:0/251750969 learned_addr learned my addr 172.21.15.37:0/251750969 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.135+0000 7facccd5b700 1 --2- 172.21.15.37:0/251750969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 0x7facc815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216053765 0 0) 0x7facc80ae9f0 con 0x7facc80b6200 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb0003570 con 0x7facc80b6200 2023-10-06T04:17:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835447008 0 0) 0x7facc80adde0 con 0x7facc80ad800 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc80ae9f0 con 0x7facc80ad800 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391132673 0 0) 0x7facb0003570 con 0x7facc80b6200 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facccd5b700 1 -- 172.21.15.37:0/251750969 >> v1:172.21.15.83:6789/0 conn(0x7facc80ad800 legacy=0x7facc80aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facccd5b700 1 -- 172.21.15.37:0/251750969 >> v1:172.21.15.37:6789/0 conn(0x7facc80b6200 legacy=0x7facc80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facccd5b700 1 -- 172.21.15.37:0/251750969 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80ae3a0 con 0x7facc80b5e30 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facccd5b700 1 --2- 172.21.15.37:0/251750969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 0x7facc815d560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facc0009e90 tx=0x7facc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e91e019dbd96cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000e070 con 0x7facc80b5e30 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc000b870 con 0x7facc80b5e30 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.136+0000 7facc77fe700 1 -- 172.21.15.37:0/251750969 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc001470 con 0x7facc80b5e30 2023-10-06T04:17:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 -- 172.21.15.37:0/251750969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 msgr2=0x7facc815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 --2- 172.21.15.37:0/251750969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 0x7facc815d560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7facc0009e90 tx=0x7facc0009780 comp rx=0 tx=0).stop 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 -- 172.21.15.37:0/251750969 shutdown_connections 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 --2- 172.21.15.37:0/251750969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80b5e30 0x7facc815d560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 -- 172.21.15.37:0/251750969 >> 172.21.15.37:0/251750969 conn(0x7facc8099a10 msgr2=0x7facc806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 -- 172.21.15.37:0/251750969 shutdown_connections 2023-10-06T04:17:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.137+0000 7faccefbf700 1 -- 172.21.15.37:0/251750969 wait complete. 2023-10-06T04:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.138+0000 7faccefbf700 1 Processor -- start 2023-10-06T04:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.138+0000 7faccefbf700 1 -- start start 2023-10-06T04:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 0x7facc814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 0x7facc816b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc815d070 con 0x7facc80b6200 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc815b110 con 0x7facc80b5e30 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccefbf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc81529d0 con 0x7facc80ad800 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52328/0 (socket says 172.21.15.37:52328) 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 -- 172.21.15.37:0/3243827499 learned_addr learned my addr 172.21.15.37:0/3243827499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7facccd5b700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 0x7facc814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7facc7fff700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 0x7facc816b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 -- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 msgr2=0x7facc814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 0x7facc814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 -- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 msgr2=0x7facc816b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 0x7facc816b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 -- 172.21.15.37:0/3243827499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0009a20 con 0x7facc80b6200 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7facccd5b700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 0x7facc814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7facc7fff700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 0x7facc816b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7faccd55c700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7facb800c590 tx=0x7facb8007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.139+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8016070 con 0x7facc80b6200 2023-10-06T04:17:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.140+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8011590 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.140+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8152c70 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.140+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8011970 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.140+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc81524e0 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.140+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80b2f90 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.141+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facb8012420 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.141+0000 7facc4ff9700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.141+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7facb8083f40 con 0x7facc80b6200 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.141+0000 7facccd5b700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.142+0000 7facccd5b700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facc0009de0 tx=0x7facc0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.145+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facb80513a0 con 0x7facc80b6200 2023-10-06T04:17:38.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.417+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7facc8063410 con 0x7facc80b6200 2023-10-06T04:17:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.418+0000 7facc4ff9700 1 -- 172.21.15.37:0/3243827499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7facb80549c0 con 0x7facc80b6200 2023-10-06T04:17:38.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:38.419 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:17:38.419 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9l7plJIxAAjtEY/eMqVjslOoPX4Xs1zA==", 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.420 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9ltY33LhAAD5Irr+67DDXOlmfiLm0Ieg==", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T04:17:38.421 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9lXsI5KhAAyyJae0HGzGnhZszmDxKF3w==", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9lpOHfNRAAfktrc51i5A0ftu/+gQtMMg==", 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.422 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAAih9ldxvVFBAAfAw0SNPQ+HA5BxVAIlcPzg==", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.423 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQADih9litYvFBAAxYWBkScFV7XPcaZp6QAmuw==", 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAGih9l64PQERAA3EdOYArRTD1EWdmkju4kyg==", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAJih9lKWHyDxAAlAhQGA0z+Go4kqEu7nWvBQ==", 2023-10-06T04:17:38.425 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAPih9lVf5RDBAATmmA0FAajS81QJWJjQGA1g==", 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.426 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQASih9lvULwChAA0ai1lp1GQsi1rIkHW+7q4A==", 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.427 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAVih9lMVx3CBAAcyCl/HpHbi0FfJhTTIS2UQ==", 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T04:17:38.428 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAYih9lulhDBhAAnq4CSvxD0VVmfuZJPyECZw==", 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9lVhPYORAAwQoJ3qfOUOVh00MPW5mYYA==", 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.429 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9iR9lOX+9BhAAZBMcVzDbo26oYQ0LNKy/3Q==", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:17:38.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9iR9lqpbAAxAAG2NvuMWXhzOPIqt2GC5xLw==", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:17:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9iR9lAMMXDBAA2kc2FjYOw5nsUcZlGwvMnw==", 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9l2TRaBhAA95D/i6oF0aU/ITjFD7zSmw==", 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.433 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9lo36+NRAA0iZTjMnmhp8eoAguJAc1Uw==", 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9llIq+NRAA80+tI66cdIzkFufMV7xtzw==", 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9lDZO+NRAAS+xdJvbwGNiaYCyaFU7E0A==", 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9lG5u+NRAA/zZJxFjLAMek2O7M7IJIkA==", 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.435 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9lVKW+NRAAubKmgyMIMqcxE2K/rDS4Zg==", 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.436 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdih9lza2+NRAAsomo4qZ2Jo5I8OkSnORj4Q==", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9lTK8gIBAA0xWRZV/ucHmwUqm24fRjDw==", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:17:38.437 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD8iR9lO+ZrGxAARweKKWos8HgplukaFq0OCg==", 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T04:17:38.439 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.419+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 msgr2=0x7facb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.419+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facc0009de0 tx=0x7facc0017000 comp rx=0 tx=0).stop 2023-10-06T04:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.419+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 msgr2=0x7facc8154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.419+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7facb800c590 tx=0x7facb8007d80 comp rx=0 tx=0).stop 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.419+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 shutdown_connections 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facc80b6200 0x7facc8154860 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7facc80ad800 0x7facc814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 --2- 172.21.15.37:0/3243827499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facc80b5e30 0x7facc816b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 >> 172.21.15.37:0/3243827499 conn(0x7facc8099a10 msgr2=0x7facc81591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 shutdown_connections 2023-10-06T04:17:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.420+0000 7faccefbf700 1 -- 172.21.15.37:0/3243827499 wait complete. 2023-10-06T04:17:38.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:17:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.561+0000 7f008149c700 1 Processor -- start 2023-10-06T04:17:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.561+0000 7f008149c700 1 -- start start 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f007c0b5e30 0x7f007c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b6200 0x7f007c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 0x7f007c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0ae9f0 con 0x7f007c0b5e30 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0adde0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f008149c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0ae0c0 con 0x7f007c0b6200 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f007c0b5e30 0x7f007c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f007c0b5e30 0x7f007c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52344/0 (socket says 172.21.15.37:52344) 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 -- 172.21.15.37:0/744349005 learned_addr learned my addr 172.21.15.37:0/744349005 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007a7fc700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b6200 0x7f007c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007b7fe700 1 --2- 172.21.15.37:0/744349005 >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 0x7f007c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 -- 172.21.15.37:0/744349005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b6200 msgr2=0x7f007c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b6200 0x7f007c15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 -- 172.21.15.37:0/744349005 >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 msgr2=0x7f007c0ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 --2- 172.21.15.37:0/744349005 >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 0x7f007c0ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 -- 172.21.15.37:0/744349005 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0ae3a0 con 0x7f007c0b5e30 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007b7fe700 1 --2- 172.21.15.37:0/744349005 >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 0x7f007c0ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f007affd700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0b5e30 0x7f007c15d560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f007c15e010 tx=0x7f0074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84cc4ee6efab8dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f0079ffb700 1 -- 172.21.15.37:0/744349005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074009e70 con 0x7f007c0b5e30 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f0079ffb700 1 -- 172.21.15.37:0/744349005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b860 con 0x7f007c0b5e30 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.562+0000 7f0079ffb700 1 -- 172.21.15.37:0/744349005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400bc20 con 0x7f007c0b5e30 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 -- 172.21.15.37:0/744349005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0b5e30 msgr2=0x7f007c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0b5e30 0x7f007c15d560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f007c15e010 tx=0x7f0074009250 comp rx=0 tx=0).stop 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 -- 172.21.15.37:0/744349005 shutdown_connections 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 --2- 172.21.15.37:0/744349005 >> v2:172.21.15.83:3300/0 conn(0x7f007c0ad0f0 0x7f007c0ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0b5e30 0x7f007c15d560 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 --2- 172.21.15.37:0/744349005 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b6200 0x7f007c15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 -- 172.21.15.37:0/744349005 >> 172.21.15.37:0/744349005 conn(0x7f007c099a10 msgr2=0x7f007c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 -- 172.21.15.37:0/744349005 shutdown_connections 2023-10-06T04:17:38.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.563+0000 7f008149c700 1 -- 172.21.15.37:0/744349005 wait complete. 2023-10-06T04:17:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.564+0000 7f008149c700 1 Processor -- start 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.564+0000 7f008149c700 1 -- start start 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b5e30 0x7f007c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007c0b6200 0x7f007c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c152ee0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c14ec50 con 0x7f007c0b6200 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f008149c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c155160 con 0x7f007c0b5e30 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52346/0 (socket says 172.21.15.37:52346) 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 -- 172.21.15.37:0/4183576252 learned_addr learned my addr 172.21.15.37:0/4183576252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007b7fe700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007c0b6200 0x7f007c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007a7fc700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b5e30 0x7f007c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 -- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b5e30 msgr2=0x7f007c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b5e30 0x7f007c15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 -- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007c0b6200 msgr2=0x7f007c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007c0b6200 0x7f007c14fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.565+0000 7f007affd700 1 -- 172.21.15.37:0/4183576252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740094f0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f007affd700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f00740094c0 tx=0x7f0074017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074000bc0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b9d0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c152920 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074025420 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.566+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c159e10 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.567+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0b2f90 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.567+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0074023070 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.568+0000 7f0072ffd700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 0x7f005c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.568+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0074085570 con 0x7f007c0ad0f0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.568+0000 7f007a7fc700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 0x7f005c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.568+0000 7f007a7fc700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 0x7f005c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0064006f00 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.572+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00740529d0 con 0x7f007c0ad0f0 2023-10-06T04:17:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.844+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f007c063410 con 0x7f007c0ad0f0 2023-10-06T04:17:38.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.848+0000 7f0072ffd700 1 -- 172.21.15.37:0/4183576252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0074009300 con 0x7f007c0ad0f0 2023-10-06T04:17:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 msgr2=0x7f005c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 0x7f005c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0064006f00 tx=0x7f0064008040 comp rx=0 tx=0).stop 2023-10-06T04:17:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 msgr2=0x7f007c151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f00740094c0 tx=0x7f0074017000 comp rx=0 tx=0).stop 2023-10-06T04:17:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 shutdown_connections 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f005c066f30 0x7f005c0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f007c0b6200 0x7f007c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f007c0ad0f0 0x7f007c151eb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 --2- 172.21.15.37:0/4183576252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f007c0b5e30 0x7f007c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.849+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 >> 172.21.15.37:0/4183576252 conn(0x7f007c099a10 msgr2=0x7f007c158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.850+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 shutdown_connections 2023-10-06T04:17:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.850+0000 7f008149c700 1 -- 172.21.15.37:0/4183576252 wait complete. 2023-10-06T04:17:38.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:17:38.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.982+0000 7f4cfe5f2700 1 Processor -- start 2023-10-06T04:17:38.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.982+0000 7f4cfe5f2700 1 -- start start 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cfe5f2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cf80b5e30 0x7f4cf815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cfe5f2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cfe5f2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80ae9f0 con 0x7f4cf80ad0f0 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cfe5f2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80adde0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cfe5f2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80ae0c0 con 0x7f4cf80b6200 2023-10-06T04:17:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cf80b5e30 0x7f4cf815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cf80b5e30 0x7f4cf815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52358/0 (socket says 172.21.15.37:52358) 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 -- 172.21.15.37:0/4135532619 learned_addr learned my addr 172.21.15.37:0/4135532619 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf77fe700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 -- 172.21.15.37:0/4135532619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 msgr2=0x7f4cf815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 -- 172.21.15.37:0/4135532619 >> v1:172.21.15.83:6789/0 conn(0x7f4cf80ad0f0 legacy=0x7f4cf80ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 -- 172.21.15.37:0/4135532619 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80ae3a0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.983+0000 7f4cf7fff700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf815d560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80099b0 tx=0x7f4ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7796b4ec302714c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.985+0000 7f4cf6ffd700 1 -- 172.21.15.37:0/4135532619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8009ea0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.985+0000 7f4cf6ffd700 1 -- 172.21.15.37:0/4135532619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800b860 con 0x7f4cf80b5e30 2023-10-06T04:17:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.985+0000 7f4cf6ffd700 1 -- 172.21.15.37:0/4135532619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800bc20 con 0x7f4cf80b5e30 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4135532619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 msgr2=0x7f4cf815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf815d560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80099b0 tx=0x7f4ce8009250 comp rx=0 tx=0).stop 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4135532619 shutdown_connections 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf815d560 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4135532619 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4135532619 >> 172.21.15.37:0/4135532619 conn(0x7f4cf8099a10 msgr2=0x7f4cf806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4135532619 shutdown_connections 2023-10-06T04:17:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.986+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4135532619 wait complete. 2023-10-06T04:17:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.987+0000 7f4cfe5f2700 1 Processor -- start 2023-10-06T04:17:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.988+0000 7f4cfe5f2700 1 -- start start 2023-10-06T04:17:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf80ad0f0 0x7f4cf816e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf816eb10 con 0x7f4cf80b5e30 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf816b5b0 con 0x7f4cf80ad0f0 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf816a9a0 con 0x7f4cf80b6200 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52366/0 (socket says 172.21.15.37:52366) 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 -- 172.21.15.37:0/4257863116 learned_addr learned my addr 172.21.15.37:0/4257863116 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf7fff700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf80ad0f0 0x7f4cf816e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfcb8f700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 -- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 msgr2=0x7f4cf80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf80d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 -- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf80ad0f0 msgr2=0x7f4cf816e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf80ad0f0 0x7f4cf816e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:38.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 -- 172.21.15.37:0/4257863116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80094f0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cf77fe700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e930 tx=0x7f4cec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec013680 con 0x7f4cf80b5e30 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0137e0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.989+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf816ac80 con 0x7f4cf80b5e30 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.990+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec013b80 con 0x7f4cf80b5e30 2023-10-06T04:17:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.990+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf816b240 con 0x7f4cf80b5e30 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.991+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf80c5400 con 0x7f4cf80b5e30 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.991+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cec00c3e0 con 0x7f4cf80b5e30 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.991+0000 7f4cdffff700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 0x7f4ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.991+0000 7f4cf7fff700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 0x7f4ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.992+0000 7f4cf7fff700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 0x7f4ce40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80099b0 tx=0x7f4ce8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:38.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.992+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4cec055c10 con 0x7f4cf80b5e30 2023-10-06T04:17:38.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:38.997+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cf80c5400 con 0x7f4cf80b5e30 2023-10-06T04:17:39.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.269+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4cf80c5400 con 0x7f4cf80b5e30 2023-10-06T04:17:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.273+0000 7f4cdffff700 1 -- 172.21.15.37:0/4257863116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4cf80c5400 con 0x7f4cf80b5e30 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 msgr2=0x7f4ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 0x7f4ce40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80099b0 tx=0x7f4ce8017000 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 msgr2=0x7f4cf8157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e930 tx=0x7f4cec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 shutdown_connections 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf80b6200 0x7f4cf80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4ce4066f30 0x7f4ce40693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf80ad0f0 0x7f4cf816e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 --2- 172.21.15.37:0/4257863116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf80b5e30 0x7f4cf8157d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 >> 172.21.15.37:0/4257863116 conn(0x7f4cf8099a10 msgr2=0x7f4cf80b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 shutdown_connections 2023-10-06T04:17:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.275+0000 7f4cfe5f2700 1 -- 172.21.15.37:0/4257863116 wait complete. 2023-10-06T04:17:39.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:17:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.407+0000 7f12407c8700 1 Processor -- start 2023-10-06T04:17:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.407+0000 7f12407c8700 1 -- start start 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.408+0000 7f12407c8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1238157340 0x7f12380c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.408+0000 7f12407c8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12380ccb80 0x7f123815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.408+0000 7f12407c8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380c9730 con 0x7f1238157710 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.408+0000 7f12407c8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123815e4a0 con 0x7f1238157340 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.408+0000 7f12407c8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380c8e00 con 0x7f12380ccb80 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1238157340 0x7f12380c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123dd63700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1238157710 0x7f12380cc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47898/0 (socket says 172.21.15.37:47898) 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123dd63700 1 -- 172.21.15.37:0/856228452 learned_addr learned my addr 172.21.15.37:0/856228452 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123ed65700 1 --2- 172.21.15.37:0/856228452 >> v2:172.21.15.83:3300/0 conn(0x7f12380ccb80 0x7f123815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 -- 172.21.15.37:0/856228452 >> v2:172.21.15.83:3300/0 conn(0x7f12380ccb80 msgr2=0x7f123815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 --2- 172.21.15.37:0/856228452 >> v2:172.21.15.83:3300/0 conn(0x7f12380ccb80 0x7f123815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 -- 172.21.15.37:0/856228452 >> v1:172.21.15.37:6789/0 conn(0x7f1238157710 legacy=0x7f12380cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 -- 172.21.15.37:0/856228452 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380c90e0 con 0x7f1238157340 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123d562700 1 -- 172.21.15.37:0/856228452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980995269 0 0) 0x7f12380c9730 con 0x7f1238157710 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123e564700 1 --2- 172.21.15.37:0/856228452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238157340 0x7f12380c9bc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1228009e60 tx=0x7f1228009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1751b07e0aedd7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123d562700 1 -- 172.21.15.37:0/856228452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122800e070 con 0x7f1238157340 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123d562700 1 -- 172.21.15.37:0/856228452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122800bbf0 con 0x7f1238157340 2023-10-06T04:17:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.409+0000 7f123d562700 1 -- 172.21.15.37:0/856228452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228012430 con 0x7f1238157340 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 -- 172.21.15.37:0/856228452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238157340 msgr2=0x7f12380c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 --2- 172.21.15.37:0/856228452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238157340 0x7f12380c9bc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1228009e60 tx=0x7f1228009780 comp rx=0 tx=0).stop 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 -- 172.21.15.37:0/856228452 shutdown_connections 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 --2- 172.21.15.37:0/856228452 >> v2:172.21.15.83:3300/0 conn(0x7f12380ccb80 0x7f123815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 --2- 172.21.15.37:0/856228452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238157340 0x7f12380c9bc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 -- 172.21.15.37:0/856228452 >> 172.21.15.37:0/856228452 conn(0x7f123806baa0 msgr2=0x7f123806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 -- 172.21.15.37:0/856228452 shutdown_connections 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.410+0000 7f12407c8700 1 -- 172.21.15.37:0/856228452 wait complete. 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.411+0000 7f12407c8700 1 Processor -- start 2023-10-06T04:17:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.411+0000 7f12407c8700 1 -- start start 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1238157340 0x7f1238154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1238157710 0x7f123815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12381603e0 con 0x7f12380ccb80 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b3540 con 0x7f1238157710 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12407c8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b3820 con 0x7f1238157340 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52386/0 (socket says 172.21.15.37:52386) 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 -- 172.21.15.37:0/3270929741 learned_addr learned my addr 172.21.15.37:0/3270929741 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 -- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1238157340 msgr2=0x7f1238154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123dd63700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1238157340 0x7f1238154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123ed65700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1238157710 0x7f123815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1238157340 0x7f1238154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 -- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1238157710 msgr2=0x7f123815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1238157710 0x7f123815e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 -- 172.21.15.37:0/3270929741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228009a20 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f123e564700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f123806b5b0 tx=0x7f1228019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.412+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228027470 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.413+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228027610 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.413+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12380b3b00 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.413+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280279d0 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.413+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12381546c0 con 0x7f12380ccb80 2023-10-06T04:17:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.414+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238063410 con 0x7f12380ccb80 2023-10-06T04:17:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.414+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1228024070 con 0x7f12380ccb80 2023-10-06T04:17:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.414+0000 7f12367fc700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.414+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1228086a50 con 0x7f12380ccb80 2023-10-06T04:17:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.414+0000 7f123dd63700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.415+0000 7f123dd63700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 0x7f12240693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f123815fa70 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.418+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1228053eb0 con 0x7f12380ccb80 2023-10-06T04:17:39.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.692+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f12380c93c0 con 0x7f12380ccb80 2023-10-06T04:17:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.695+0000 7f12367fc700 1 -- 172.21.15.37:0/3270929741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f12280574d0 con 0x7f12380ccb80 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 msgr2=0x7f12240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 0x7f12240693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f123815fa70 tx=0x7f122c009040 comp rx=0 tx=0).stop 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 msgr2=0x7f123815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f123806b5b0 tx=0x7f1228019000 comp rx=0 tx=0).stop 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 shutdown_connections 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1238157710 0x7f123815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12380ccb80 0x7f123815fd50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 --2- 172.21.15.37:0/3270929741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1238157340 0x7f1238154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 >> 172.21.15.37:0/3270929741 conn(0x7f123806baa0 msgr2=0x7f12380caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 shutdown_connections 2023-10-06T04:17:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.697+0000 7f12407c8700 1 -- 172.21.15.37:0/3270929741 wait complete. 2023-10-06T04:17:39.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:17:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.828+0000 7fac6b3b1700 1 Processor -- start 2023-10-06T04:17:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6b3b1700 1 -- start start 2023-10-06T04:17:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6b3b1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac640ccac0 0x7fac6406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6b3b1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac640ccf70 con 0x7fac640b3d80 2023-10-06T04:17:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6b3b1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac640cd250 con 0x7fac640b4150 2023-10-06T04:17:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6b3b1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac640cd530 con 0x7fac640ccac0 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6914d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac640b3d80 0x7fac640cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47900/0 (socket says 172.21.15.37:47900) 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.829+0000 7fac6914d700 1 -- 172.21.15.37:0/1395693973 learned_addr learned my addr 172.21.15.37:0/1395693973 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6894c700 1 --2- 172.21.15.37:0/1395693973 >> v2:172.21.15.83:3300/0 conn(0x7fac640ccac0 0x7fac6406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690082166 0 0) 0x7fac640ccf70 con 0x7fac640b3d80 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac4c003570 con 0x7fac640b3d80 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 85289076 0 0) 0x7fac4c003570 con 0x7fac640b3d80 2023-10-06T04:17:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 >> v2:172.21.15.83:3300/0 conn(0x7fac640ccac0 msgr2=0x7fac6406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 --2- 172.21.15.37:0/1395693973 >> v2:172.21.15.83:3300/0 conn(0x7fac640ccac0 0x7fac6406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 >> v1:172.21.15.83:6789/0 conn(0x7fac640b4150 legacy=0x7fac64158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac640cd810 con 0x7fac640b3d80 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fac5c0015f0 con 0x7fac640b3d80 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 >> v1:172.21.15.37:6789/0 conn(0x7fac640b3d80 legacy=0x7fac640cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c004810 0x7fac4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c0051c0 0x7fac4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac640cd530 con 0x7fac4c003a60 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c00c050 con 0x7fac4c004810 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c00c210 con 0x7fac4c0051c0 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6894c700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c004810 0x7fac4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6994e700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c0051c0 0x7fac4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 -- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c0051c0 msgr2=0x7fac4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac4c0051c0 0x7fac4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 -- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c004810 msgr2=0x7fac4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c004810 0x7fac4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6914d700 1 -- 172.21.15.37:0/1395693973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c003570 con 0x7fac4c003a60 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6994e700 1 -- 172.21.15.37:0/1395693973 reap_dead start 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.830+0000 7fac6894c700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac4c004810 0x7fac4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6914d700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac4c003e30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c300 tx=0x7fac5c007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bff54181fd7eb7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00cc30 con 0x7fac4c003a60 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c00cdb0 con 0x7fac4c003a60 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac63fff700 1 -- 172.21.15.37:0/1395693973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c001de0 con 0x7fac4c003a60 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 -- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 msgr2=0x7fac4c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac4c003e30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c300 tx=0x7fac5c007920 comp rx=0 tx=0).stop 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 -- 172.21.15.37:0/1395693973 shutdown_connections 2023-10-06T04:17:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/1395693973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac4c003e30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 -- 172.21.15.37:0/1395693973 >> 172.21.15.37:0/1395693973 conn(0x7fac640ce470 msgr2=0x7fac640ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 -- 172.21.15.37:0/1395693973 shutdown_connections 2023-10-06T04:17:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.831+0000 7fac6b3b1700 1 -- 172.21.15.37:0/1395693973 wait complete. 2023-10-06T04:17:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.832+0000 7fac6b3b1700 1 Processor -- start 2023-10-06T04:17:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 -- start start 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac640ae720 0x7fac6414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac6415b0b0 0x7fac641565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6416e040 con 0x7fac4c003a60 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6414b7b0 con 0x7fac6415b0b0 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6b3b1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac64069810 con 0x7fac640ae720 2023-10-06T04:17:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.833+0000 7fac6914d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52400/0 (socket says 172.21.15.37:52400) 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 -- 172.21.15.37:0/3908959642 learned_addr learned my addr 172.21.15.37:0/3908959642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6894c700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac640ae720 0x7fac6414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6994e700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac6415b0b0 0x7fac641565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 -- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac640ae720 msgr2=0x7fac6414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac640ae720 0x7fac6414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 -- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac6415b0b0 msgr2=0x7fac641565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac6415b0b0 0x7fac641565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 -- 172.21.15.37:0/3908959642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64069120 con 0x7fac4c003a60 2023-10-06T04:17:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6914d700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000e50 tx=0x7fac5c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c002d40 con 0x7fac4c003a60 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c001900 con 0x7fac4c003a60 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6416d7a0 con 0x7fac4c003a60 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c007510 con 0x7fac4c003a60 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.834+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6416dd60 con 0x7fac4c003a60 2023-10-06T04:17:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.835+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac64063410 con 0x7fac4c003a60 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.836+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac5c005a00 con 0x7fac4c003a60 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.836+0000 7fac617fa700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 0x7fac500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.836+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fac5c085610 con 0x7fac4c003a60 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.836+0000 7fac6894c700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 0x7fac500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.837+0000 7fac6894c700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 0x7fac500693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac64068e80 tx=0x7fac58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:39.840+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac5c052a70 con 0x7fac4c003a60 2023-10-06T04:17:40.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.112+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fac640aee20 con 0x7fac4c003a60 2023-10-06T04:17:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.115+0000 7fac617fa700 1 -- 172.21.15.37:0/3908959642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fac5c007670 con 0x7fac4c003a60 2023-10-06T04:17:40.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 msgr2=0x7fac500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 0x7fac500693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac64068e80 tx=0x7fac58008040 comp rx=0 tx=0).stop 2023-10-06T04:17:40.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 msgr2=0x7fac6416d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000e50 tx=0x7fac5c015000 comp rx=0 tx=0).stop 2023-10-06T04:17:40.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 shutdown_connections 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fac50066f30 0x7fac500693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac6415b0b0 0x7fac641565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac4c003a60 0x7fac6416d0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 --2- 172.21.15.37:0/3908959642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac640ae720 0x7fac6414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 >> 172.21.15.37:0/3908959642 conn(0x7fac640ce470 msgr2=0x7fac64150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 shutdown_connections 2023-10-06T04:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.117+0000 7fac6b3b1700 1 -- 172.21.15.37:0/3908959642 wait complete. 2023-10-06T04:17:40.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:17:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.250+0000 7f0221389700 1 Processor -- start 2023-10-06T04:17:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.250+0000 7f0221389700 1 -- start start 2023-10-06T04:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f0221389700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021c0ccac0 0x7f021c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f0221389700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0ccf70 con 0x7f021c0b3d80 2023-10-06T04:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f0221389700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0cd250 con 0x7f021c0b4150 2023-10-06T04:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f0221389700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0cd530 con 0x7f021c0ccac0 2023-10-06T04:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f021a7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021c0ccac0 0x7f021c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f021affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f021c0b3d80 0x7f021c0cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47914/0 (socket says 172.21.15.37:47914) 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.251+0000 7f021affd700 1 -- 172.21.15.37:0/3202470606 learned_addr learned my addr 172.21.15.37:0/3202470606 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f021a7fc700 1 -- 172.21.15.37:0/3202470606 >> v1:172.21.15.83:6789/0 conn(0x7f021c0b4150 legacy=0x7f021c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f021a7fc700 1 -- 172.21.15.37:0/3202470606 >> v1:172.21.15.37:6789/0 conn(0x7f021c0b3d80 legacy=0x7f021c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f0219ffb700 1 -- 172.21.15.37:0/3202470606 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353522196 0 0) 0x7f021c0ccf70 con 0x7f021c0b3d80 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f021a7fc700 1 -- 172.21.15.37:0/3202470606 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0cd810 con 0x7f021c0ccac0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f021a7fc700 1 --2- 172.21.15.37:0/3202470606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0ccac0 0x7f021c06b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02040098e0 tx=0x7f02040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d35d00c9b064161 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f0219ffb700 1 -- 172.21.15.37:0/3202470606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204009e80 con 0x7f021c0ccac0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f0219ffb700 1 -- 172.21.15.37:0/3202470606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400b860 con 0x7f021c0ccac0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f0219ffb700 1 -- 172.21.15.37:0/3202470606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400bbe0 con 0x7f021c0ccac0 2023-10-06T04:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.252+0000 7f0221389700 1 -- 172.21.15.37:0/3202470606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0ccac0 msgr2=0x7f021c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 --2- 172.21.15.37:0/3202470606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0ccac0 0x7f021c06b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02040098e0 tx=0x7f02040091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 -- 172.21.15.37:0/3202470606 shutdown_connections 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 --2- 172.21.15.37:0/3202470606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0ccac0 0x7f021c06b9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 -- 172.21.15.37:0/3202470606 >> 172.21.15.37:0/3202470606 conn(0x7f021c0ce470 msgr2=0x7f021c0ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 -- 172.21.15.37:0/3202470606 shutdown_connections 2023-10-06T04:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.253+0000 7f0221389700 1 -- 172.21.15.37:0/3202470606 wait complete. 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.254+0000 7f0221389700 1 Processor -- start 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.254+0000 7f0221389700 1 -- start start 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021c0b3d80 0x7f021c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 0x7f021c0c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c154ff0 con 0x7f021c0b4150 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1552d0 con 0x7f021c0b3d80 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1555b0 con 0x7f021c0ccac0 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52416/0 (socket says 172.21.15.37:52416) 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 -- 172.21.15.37:0/95202299 learned_addr learned my addr 172.21.15.37:0/95202299 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021affd700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021c0b3d80 0x7f021c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021b7fe700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 0x7f021c0c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 -- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 msgr2=0x7f021c0c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 0x7f021c0c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 -- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021c0b3d80 msgr2=0x7f021c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021c0b3d80 0x7f021c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 -- 172.21.15.37:0/95202299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009420 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021b7fe700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 0x7f021c0c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f021a7fc700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0204013000 tx=0x7f0204017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020401f070 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400b9d0 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c155890 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.255+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204025670 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.256+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c1570b0 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.256+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c1572a0 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.257+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0204023070 con 0x7f021c0b4150 2023-10-06T04:17:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.257+0000 7f0212ffd700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 0x7f01fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.257+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f02040859b0 con 0x7f021c0b4150 2023-10-06T04:17:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.257+0000 7f021affd700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 0x7f01fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.258+0000 7f021affd700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 0x7f01fc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f80 tx=0x7f0214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.261+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0204052e10 con 0x7f021c0b4150 2023-10-06T04:17:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.535+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f021c063410 con 0x7f021c0b4150 2023-10-06T04:17:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.539+0000 7f0212ffd700 1 -- 172.21.15.37:0/95202299 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02040150a0 con 0x7f021c0b4150 2023-10-06T04:17:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 msgr2=0x7f01fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 0x7f01fc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0214000f80 tx=0x7f0214009040 comp rx=0 tx=0).stop 2023-10-06T04:17:40.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 msgr2=0x7f021c0c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0204013000 tx=0x7f0204017000 comp rx=0 tx=0).stop 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 shutdown_connections 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f021c0ccac0 0x7f021c0c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f01fc066f30 0x7f01fc0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f021c0b3d80 0x7f021c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 --2- 172.21.15.37:0/95202299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021c0b4150 0x7f021c0c5140 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.540+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 >> 172.21.15.37:0/95202299 conn(0x7f021c0ce470 msgr2=0x7f021c151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.541+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 shutdown_connections 2023-10-06T04:17:40.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.541+0000 7f0221389700 1 -- 172.21.15.37:0/95202299 wait complete. 2023-10-06T04:17:40.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:17:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.672+0000 7f9d8e963700 1 Processor -- start 2023-10-06T04:17:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.672+0000 7f9d8e963700 1 -- start start 2023-10-06T04:17:40.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8e963700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9d8806a300 0x7f9d8815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8e963700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d880cc040 0x7f9d880cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8e963700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8815af30 con 0x7f9d8806ce10 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8e963700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880cca20 con 0x7f9d880cc040 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8e963700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d88159df0 con 0x7f9d8806a300 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d877fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d880cc040 0x7f9d880cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8cf00700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d8806ce10 0x7f9d8806d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47928/0 (socket says 172.21.15.37:47928) 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.673+0000 7f9d8cf00700 1 -- 172.21.15.37:0/4016386382 learned_addr learned my addr 172.21.15.37:0/4016386382 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d87fff700 1 --2- 172.21.15.37:0/4016386382 >> v2:172.21.15.83:3300/0 conn(0x7f9d8806a300 0x7f9d8815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d877fe700 1 -- 172.21.15.37:0/4016386382 >> v2:172.21.15.83:3300/0 conn(0x7f9d8806a300 msgr2=0x7f9d8815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d877fe700 1 --2- 172.21.15.37:0/4016386382 >> v2:172.21.15.83:3300/0 conn(0x7f9d8806a300 0x7f9d8815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d877fe700 1 -- 172.21.15.37:0/4016386382 >> v1:172.21.15.37:6789/0 conn(0x7f9d8806ce10 legacy=0x7f9d8806d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d877fe700 1 -- 172.21.15.37:0/4016386382 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8815d8e0 con 0x7f9d880cc040 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d86ffd700 1 -- 172.21.15.37:0/4016386382 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643681242 0 0) 0x7f9d80001490 con 0x7f9d8806ce10 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d877fe700 1 --2- 172.21.15.37:0/4016386382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880cc040 0x7f9d880cc4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ce3d0 tx=0x7f9d7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc550b7935af129 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d86ffd700 1 -- 172.21.15.37:0/4016386382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00b6b0 con 0x7f9d880cc040 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d86ffd700 1 -- 172.21.15.37:0/4016386382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00b810 con 0x7f9d880cc040 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.674+0000 7f9d86ffd700 1 -- 172.21.15.37:0/4016386382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00bbb0 con 0x7f9d880cc040 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 -- 172.21.15.37:0/4016386382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880cc040 msgr2=0x7f9d880cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 --2- 172.21.15.37:0/4016386382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880cc040 0x7f9d880cc4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ce3d0 tx=0x7f9d7c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 -- 172.21.15.37:0/4016386382 shutdown_connections 2023-10-06T04:17:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 --2- 172.21.15.37:0/4016386382 >> v2:172.21.15.83:3300/0 conn(0x7f9d8806a300 0x7f9d8815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 --2- 172.21.15.37:0/4016386382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880cc040 0x7f9d880cc4e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 -- 172.21.15.37:0/4016386382 >> 172.21.15.37:0/4016386382 conn(0x7f9d880ce470 msgr2=0x7f9d880ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 -- 172.21.15.37:0/4016386382 shutdown_connections 2023-10-06T04:17:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.675+0000 7f9d8e963700 1 -- 172.21.15.37:0/4016386382 wait complete. 2023-10-06T04:17:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.676+0000 7f9d8e963700 1 Processor -- start 2023-10-06T04:17:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.676+0000 7f9d8e963700 1 -- start start 2023-10-06T04:17:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d8806ce10 0x7f9d8816d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d880cc040 0x7f9d880c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880c59c0 con 0x7f9d8806a300 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8816db40 con 0x7f9d8806ce10 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8e963700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8816de20 con 0x7f9d880cc040 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52428/0 (socket says 172.21.15.37:52428) 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 -- 172.21.15.37:0/1973956789 learned_addr learned my addr 172.21.15.37:0/1973956789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d8cf00700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d880cc040 0x7f9d880c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 -- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d880cc040 msgr2=0x7f9d880c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d877fe700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d8806ce10 0x7f9d8816d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d880cc040 0x7f9d880c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 -- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d8806ce10 msgr2=0x7f9d8816d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d8806ce10 0x7f9d8816d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 -- 172.21.15.37:0/1973956789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009420 con 0x7f9d8806a300 2023-10-06T04:17:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d87fff700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800d810 tx=0x7f9d78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.677+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780125f0 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.678+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78012750 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.678+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d880c5650 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.678+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78012b10 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.678+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d880c6390 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.679+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88063410 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.679+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d7801e460 con 0x7f9d8806a300 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.679+0000 7f9d6ffff700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.679+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9d78084a60 con 0x7f9d8806a300 2023-10-06T04:17:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.680+0000 7f9d877fe700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.680+0000 7f9d877fe700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0093f0 tx=0x7f9d7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.683+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d78051ec0 con 0x7f9d8806a300 2023-10-06T04:17:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.956+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9d8815dbc0 con 0x7f9d8806a300 2023-10-06T04:17:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.960+0000 7f9d6ffff700 1 -- 172.21.15.37:0/1973956789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9d780554e0 con 0x7f9d8806a300 2023-10-06T04:17:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 msgr2=0x7f9d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 0x7f9d740693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0093f0 tx=0x7f9d7c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 msgr2=0x7f9d88146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800d810 tx=0x7f9d78008040 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 shutdown_connections 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9d880cc040 0x7f9d880c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d8806a300 0x7f9d88146240 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9d74066f30 0x7f9d740693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 --2- 172.21.15.37:0/1973956789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9d8806ce10 0x7f9d8816d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 >> 172.21.15.37:0/1973956789 conn(0x7f9d880ce470 msgr2=0x7f9d88158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 shutdown_connections 2023-10-06T04:17:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:40.962+0000 7f9d8e963700 1 -- 172.21.15.37:0/1973956789 wait complete. 2023-10-06T04:17:40.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.093+0000 7fcaa4efc700 1 Processor -- start 2023-10-06T04:17:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 -- start start 2023-10-06T04:17:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 0x7fcaa00ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00ae9f0 con 0x7fcaa00b5e30 2023-10-06T04:17:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00adb70 con 0x7fcaa015dc70 2023-10-06T04:17:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.094+0000 7fcaa4efc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00adde0 con 0x7fcaa00b6200 2023-10-06T04:17:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:60174/0 (socket says 172.21.15.37:60174) 2023-10-06T04:17:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 -- 172.21.15.37:0/2234111413 learned_addr learned my addr 172.21.15.37:0/2234111413 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9dd9b700 1 --2- 172.21.15.37:0/2234111413 >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 0x7fcaa00ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 -- 172.21.15.37:0/2234111413 >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 msgr2=0x7fcaa00ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 --2- 172.21.15.37:0/2234111413 >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 0x7fcaa00ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 -- 172.21.15.37:0/2234111413 >> v1:172.21.15.83:6789/0 conn(0x7fcaa00b5e30 legacy=0x7fcaa015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 -- 172.21.15.37:0/2234111413 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00ae0c0 con 0x7fcaa00b6200 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9dd9b700 1 --2- 172.21.15.37:0/2234111413 >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 0x7fcaa00ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.095+0000 7fca9ed9d700 1 --2- 172.21.15.37:0/2234111413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca90009f20 tx=0x7fca90009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e4039a49c28d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fca9d59a700 1 -- 172.21.15.37:0/2234111413 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000e070 con 0x7fcaa00b6200 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fca9d59a700 1 -- 172.21.15.37:0/2234111413 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000b9d0 con 0x7fcaa00b6200 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fca9d59a700 1 -- 172.21.15.37:0/2234111413 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca900092e0 con 0x7fcaa00b6200 2023-10-06T04:17:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 -- 172.21.15.37:0/2234111413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 msgr2=0x7fcaa00ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/2234111413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca90009f20 tx=0x7fca90009840 comp rx=0 tx=0).stop 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 -- 172.21.15.37:0/2234111413 shutdown_connections 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/2234111413 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa00ad630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/2234111413 >> v2:172.21.15.83:3300/0 conn(0x7fcaa015dc70 0x7fcaa00ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 -- 172.21.15.37:0/2234111413 >> 172.21.15.37:0/2234111413 conn(0x7fcaa0099a10 msgr2=0x7fcaa006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 -- 172.21.15.37:0/2234111413 shutdown_connections 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.096+0000 7fcaa4efc700 1 -- 172.21.15.37:0/2234111413 wait complete. 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.097+0000 7fcaa4efc700 1 Processor -- start 2023-10-06T04:17:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.097+0000 7fcaa4efc700 1 -- start start 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa01527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa015dc70 0x7fcaa0158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0153e90 con 0x7fcaa00b5e30 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0153280 con 0x7fcaa015dc70 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fcaa4efc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0153560 con 0x7fcaa00b6200 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52444/0 (socket says 172.21.15.37:52444) 2023-10-06T04:17:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 -- 172.21.15.37:0/3662288799 learned_addr learned my addr 172.21.15.37:0/3662288799 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9dd9b700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa01527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9ed9d700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa015dc70 0x7fcaa0158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 -- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 msgr2=0x7fcaa01527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa01527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 -- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa015dc70 msgr2=0x7fcaa0158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa015dc70 0x7fcaa0158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.098+0000 7fca9e59c700 1 -- 172.21.15.37:0/3662288799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009420 con 0x7fcaa00b5e30 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fca9e59c700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c590 tx=0x7fca9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98011590 con 0x7fcaa00b5e30 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98011710 con 0x7fcaa00b5e30 2023-10-06T04:17:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca90009ae0 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98011ad0 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.099+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0153b20 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.100+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa00b2f90 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.100+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca9801b3b0 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.100+0000 7fca967fc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.101+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fca980837d0 con 0x7fcaa00b5e30 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.101+0000 7fca9dd9b700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.101+0000 7fca9dd9b700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00b3d60 tx=0x7fca880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.105+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca98050c30 con 0x7fcaa00b5e30 2023-10-06T04:17:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.300+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa0154170 con 0x7fcaa00b5e30 2023-10-06T04:17:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.300+0000 7fca967fc700 1 -- 172.21.15.37:0/3662288799 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13602 (secure 0 0 0) 0x7fca98017070 con 0x7fcaa00b5e30 2023-10-06T04:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:17:38.003261+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 msgr2=0x7fca800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00b3d60 tx=0x7fca880091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 msgr2=0x7fcaa013f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c590 tx=0x7fca9800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 shutdown_connections 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaa015dc70 0x7fcaa0158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa00b5e30 0x7fcaa013f6a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 --2- 172.21.15.37:0/3662288799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcaa00b6200 0x7fcaa01527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 >> 172.21.15.37:0/3662288799 conn(0x7fcaa0099a10 msgr2=0x7fcaa00ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 shutdown_connections 2023-10-06T04:17:41.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.303+0000 7fcaa4efc700 1 -- 172.21.15.37:0/3662288799 wait complete. 2023-10-06T04:17:41.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T04:17:41.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.437+0000 7fc1e5587700 1 Processor -- start 2023-10-06T04:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.437+0000 7fc1e5587700 1 -- start start 2023-10-06T04:17:41.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1e5587700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e0159830 0x7fc1e00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1e5587700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1e00cf210 0x7fc1e0163330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1e5587700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e0159c00 con 0x7fc1e00ccfa0 2023-10-06T04:17:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1e5587700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00cb940 con 0x7fc1e00cf210 2023-10-06T04:17:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1e5587700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00cbc20 con 0x7fc1e0159830 2023-10-06T04:17:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1df7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1e00cf210 0x7fc1e0163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1df7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1e00cf210 0x7fc1e0163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52456/0 (socket says 172.21.15.37:52456) 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1df7fe700 1 -- 172.21.15.37:0/2510949934 learned_addr learned my addr 172.21.15.37:0/2510949934 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.438+0000 7fc1deffd700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e0159830 0x7fc1e00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1df7fe700 1 -- 172.21.15.37:0/2510949934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e0159830 msgr2=0x7fc1e00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1df7fe700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e0159830 0x7fc1e00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1df7fe700 1 -- 172.21.15.37:0/2510949934 >> v1:172.21.15.83:6789/0 conn(0x7fc1e00ccfa0 legacy=0x7fc1e00ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1df7fe700 1 -- 172.21.15.37:0/2510949934 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00cbf00 con 0x7fc1e00cf210 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1df7fe700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e00cf210 0x7fc1e0163330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00099b0 tx=0x7fc1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e02aa11c9ce28b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1ddffb700 1 -- 172.21.15.37:0/2510949934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009ea0 con 0x7fc1e00cf210 2023-10-06T04:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1ddffb700 1 -- 172.21.15.37:0/2510949934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d000b860 con 0x7fc1e00cf210 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.439+0000 7fc1ddffb700 1 -- 172.21.15.37:0/2510949934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000bc00 con 0x7fc1e00cf210 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 -- 172.21.15.37:0/2510949934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e00cf210 msgr2=0x7fc1e0163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e00cf210 0x7fc1e0163330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00099b0 tx=0x7fc1d0009250 comp rx=0 tx=0).stop 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 -- 172.21.15.37:0/2510949934 shutdown_connections 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e00cf210 0x7fc1e0163330 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 --2- 172.21.15.37:0/2510949934 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e0159830 0x7fc1e00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 -- 172.21.15.37:0/2510949934 >> 172.21.15.37:0/2510949934 conn(0x7fc1e0099950 msgr2=0x7fc1e006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 -- 172.21.15.37:0/2510949934 shutdown_connections 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.440+0000 7fc1e5587700 1 -- 172.21.15.37:0/2510949934 wait complete. 2023-10-06T04:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.441+0000 7fc1e5587700 1 Processor -- start 2023-10-06T04:17:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.441+0000 7fc1e5587700 1 -- start start 2023-10-06T04:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 0x7fc1e014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 0x7fc1e0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e014cf70 con 0x7fc1e0159830 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00c7bb0 con 0x7fc1e00cf210 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00c7e90 con 0x7fc1e00ccfa0 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52470/0 (socket says 172.21.15.37:52470) 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 -- 172.21.15.37:0/3449782513 learned_addr learned my addr 172.21.15.37:0/3449782513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1deffd700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 0x7fc1e014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1de7fc700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 0x7fc1e0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 -- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 msgr2=0x7fc1e014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 0x7fc1e014ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 -- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 msgr2=0x7fc1e0151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 0x7fc1e0151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 -- 172.21.15.37:0/3449782513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00094f0 con 0x7fc1e0159830 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1deffd700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 0x7fc1e014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1de7fc700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 0x7fc1e0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1df7fe700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc1e006fd70 tx=0x7fc1d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000bba0 con 0x7fc1e0159830 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0025420 con 0x7fc1e0159830 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00257e0 con 0x7fc1e0159830 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.442+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e00c8170 con 0x7fc1e0159830 2023-10-06T04:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.443+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0151840 con 0x7fc1e0159830 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.443+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0063410 con 0x7fc1e0159830 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.444+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1d0023070 con 0x7fc1e0159830 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.444+0000 7fc1d6ffd700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.444+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc1d0085b50 con 0x7fc1e0159830 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.444+0000 7fc1deffd700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.445+0000 7fc1deffd700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 0x7fc1c00693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009fd0 tx=0x7fc1d800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.448+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1d0052fb0 con 0x7fc1e0159830 2023-10-06T04:17:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.642+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1e00cc1e0 con 0x7fc1e0159830 2023-10-06T04:17:41.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.642+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3449782513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1d00565d0 con 0x7fc1e0159830 2023-10-06T04:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 msgr2=0x7fc1c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 0x7fc1c00693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009fd0 tx=0x7fc1d800b040 comp rx=0 tx=0).stop 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 msgr2=0x7fc1e0150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc1e006fd70 tx=0x7fc1d0017000 comp rx=0 tx=0).stop 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 shutdown_connections 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0159830 0x7fc1e0150600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1e00ccfa0 0x7fc1e014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc1c0066f30 0x7fc1c00693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 --2- 172.21.15.37:0/3449782513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1e00cf210 0x7fc1e0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 >> 172.21.15.37:0/3449782513 conn(0x7fc1e0099950 msgr2=0x7fc1e0069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 shutdown_connections 2023-10-06T04:17:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.644+0000 7fc1e5587700 1 -- 172.21.15.37:0/3449782513 wait complete. 2023-10-06T04:17:41.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:17:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.778+0000 7fcbaf15d700 1 Processor -- start 2023-10-06T04:17:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.778+0000 7fcbaf15d700 1 -- start start 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbaf15d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcba80ce260 0x7fcba80cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbaf15d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcba80ceff0 0x7fcba80cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbaf15d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba80cdb20 con 0x7fcba8159dc0 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbaf15d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba80b3090 con 0x7fcba80ce260 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbaf15d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba80cf9b0 con 0x7fcba80ceff0 2023-10-06T04:17:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcba7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcba80ce260 0x7fcba80cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbacef9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcba8159dc0 0x7fcba80ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47940/0 (socket says 172.21.15.37:47940) 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbacef9700 1 -- 172.21.15.37:0/2020886528 learned_addr learned my addr 172.21.15.37:0/2020886528 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcbad6fa700 1 --2- 172.21.15.37:0/2020886528 >> v2:172.21.15.83:3300/0 conn(0x7fcba80ceff0 0x7fcba80cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcba7fff700 1 -- 172.21.15.37:0/2020886528 >> v2:172.21.15.83:3300/0 conn(0x7fcba80ceff0 msgr2=0x7fcba80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcba7fff700 1 --2- 172.21.15.37:0/2020886528 >> v2:172.21.15.83:3300/0 conn(0x7fcba80ceff0 0x7fcba80cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcba7fff700 1 -- 172.21.15.37:0/2020886528 >> v1:172.21.15.37:6789/0 conn(0x7fcba8159dc0 legacy=0x7fcba80ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcba7fff700 1 -- 172.21.15.37:0/2020886528 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80c5430 con 0x7fcba80ce260 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.779+0000 7fcba77fe700 1 -- 172.21.15.37:0/2020886528 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563498467 0 0) 0x7fcba80cdb20 con 0x7fcba8159dc0 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcba7fff700 1 --2- 172.21.15.37:0/2020886528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ce260 0x7fcba80cc6a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcba808a9b0 tx=0x7fcb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106dd2427257213a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcba77fe700 1 -- 172.21.15.37:0/2020886528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00b6b0 con 0x7fcba80ce260 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcba77fe700 1 -- 172.21.15.37:0/2020886528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00b810 con 0x7fcba80ce260 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcba77fe700 1 -- 172.21.15.37:0/2020886528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00bbb0 con 0x7fcba80ce260 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 -- 172.21.15.37:0/2020886528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ce260 msgr2=0x7fcba80cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/2020886528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ce260 0x7fcba80cc6a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcba808a9b0 tx=0x7fcb9c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 -- 172.21.15.37:0/2020886528 shutdown_connections 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/2020886528 >> v2:172.21.15.83:3300/0 conn(0x7fcba80ceff0 0x7fcba80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/2020886528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ce260 0x7fcba80cc6a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 -- 172.21.15.37:0/2020886528 >> 172.21.15.37:0/2020886528 conn(0x7fcba8099a50 msgr2=0x7fcba806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 -- 172.21.15.37:0/2020886528 shutdown_connections 2023-10-06T04:17:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.780+0000 7fcbaf15d700 1 -- 172.21.15.37:0/2020886528 wait complete. 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.781+0000 7fcbaf15d700 1 Processor -- start 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 -- start start 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcba80ce260 0x7fcba8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcba8159dc0 0x7fcba80b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80c90e0 con 0x7fcba80ceff0 2023-10-06T04:17:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80c9c20 con 0x7fcba8159dc0 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcbaf15d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80c92f0 con 0x7fcba80ce260 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcba7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcba7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52476/0 (socket says 172.21.15.37:52476) 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.782+0000 7fcba7fff700 1 -- 172.21.15.37:0/1687043301 learned_addr learned my addr 172.21.15.37:0/1687043301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcbacef9700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcba80ce260 0x7fcba8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcbad6fa700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcba8159dc0 0x7fcba80b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 -- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcba80ce260 msgr2=0x7fcba8158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcba80ce260 0x7fcba8158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 -- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcba8159dc0 msgr2=0x7fcba80b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcba8159dc0 0x7fcba80b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 -- 172.21.15.37:0/1687043301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009420 con 0x7fcba80ceff0 2023-10-06T04:17:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba7fff700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c013000 tx=0x7fcb9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00b980 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00bb00 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba80c95d0 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c025670 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.783+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba814c780 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.784+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba80c9d90 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.785+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb9c023070 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.785+0000 7fcba4ff9700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.785+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcb9c0859a0 con 0x7fcba80ceff0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.785+0000 7fcbacef9700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.786+0000 7fcbacef9700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb980028b0 tx=0x7fcb98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:41.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.789+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb9c052e00 con 0x7fcba80ceff0 2023-10-06T04:17:41.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.983+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcba804c3c0 con 0x7fcba80ceff0 2023-10-06T04:17:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.983+0000 7fcba4ff9700 1 -- 172.21.15.37:0/1687043301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb9c056420 con 0x7fcba80ceff0 2023-10-06T04:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:17:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 msgr2=0x7fcb940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb980028b0 tx=0x7fcb98009040 comp rx=0 tx=0).stop 2023-10-06T04:17:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 msgr2=0x7fcba814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c013000 tx=0x7fcb9c017000 comp rx=0 tx=0).stop 2023-10-06T04:17:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 shutdown_connections 2023-10-06T04:17:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcba8159dc0 0x7fcba80b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcba80ce260 0x7fcba8158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 --2- 172.21.15.37:0/1687043301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcba80ceff0 0x7fcba814c240 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 >> 172.21.15.37:0/1687043301 conn(0x7fcba8099a50 msgr2=0x7fcba80cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 shutdown_connections 2023-10-06T04:17:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:41.985+0000 7fcbaf15d700 1 -- 172.21.15.37:0/1687043301 wait complete. 2023-10-06T04:17:42.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:17:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.117+0000 7f2d7597e700 1 Processor -- start 2023-10-06T04:17:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.117+0000 7f2d7597e700 1 -- start start 2023-10-06T04:17:42.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.117+0000 7f2d7597e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d7015ae70 0x7f2d7015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d7597e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700697d0 con 0x7f2d700b3b10 2023-10-06T04:17:42.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d7597e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d70069ab0 con 0x7f2d700b3ee0 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d7597e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d70069d90 con 0x7f2d7015ae70 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d700b3b10 0x7f2d70068d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47948/0 (socket says 172.21.15.37:47948) 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6effd700 1 -- 172.21.15.37:0/1936468379 learned_addr learned my addr 172.21.15.37:0/1936468379 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773472410 0 0) 0x7f2d700697d0 con 0x7f2d700b3b10 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d58003570 con 0x7f2d700b3b10 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6f7fe700 1 --2- 172.21.15.37:0/1936468379 >> v2:172.21.15.83:3300/0 conn(0x7f2d7015ae70 0x7f2d7015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836819153 0 0) 0x7f2d58003570 con 0x7f2d700b3b10 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 >> v2:172.21.15.83:3300/0 conn(0x7f2d7015ae70 msgr2=0x7f2d7015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 --2- 172.21.15.37:0/1936468379 >> v2:172.21.15.83:3300/0 conn(0x7f2d7015ae70 0x7f2d7015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 >> v1:172.21.15.83:6789/0 conn(0x7f2d700b3ee0 legacy=0x7f2d7015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7006a070 con 0x7f2d700b3b10 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f2d600015f0 con 0x7f2d700b3b10 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 >> v1:172.21.15.37:6789/0 conn(0x7f2d700b3b10 legacy=0x7f2d70068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d58003a60 0x7f2d58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d580052e0 0x7f2d5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70069d90 con 0x7f2d58004810 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5800c230 con 0x7f2d58003a60 2023-10-06T04:17:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5800c3f0 con 0x7f2d580052e0 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.118+0000 7f2d6effd700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d58003a60 0x7f2d58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6f7fe700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d580052e0 0x7f2d5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 -- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d580052e0 msgr2=0x7f2d5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d580052e0 0x7f2d5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 -- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d58003a60 msgr2=0x7f2d58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d58003a60 0x7f2d58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 -- 172.21.15.37:0/1936468379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58003570 con 0x7f2d58004810 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/1936468379 reap_dead start 2023-10-06T04:17:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d58004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d640018b0 tx=0x7f2d64007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf8ba0d711e2494 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012420 con 0x7f2d58004810 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d640125a0 con 0x7f2d58004810 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.119+0000 7f2d6dffb700 1 -- 172.21.15.37:0/1936468379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012960 con 0x7f2d58004810 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 -- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 msgr2=0x7f2d58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d58004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d640018b0 tx=0x7f2d64007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 -- 172.21.15.37:0/1936468379 shutdown_connections 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 --2- 172.21.15.37:0/1936468379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d58004c80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 -- 172.21.15.37:0/1936468379 >> 172.21.15.37:0/1936468379 conn(0x7f2d700ce470 msgr2=0x7f2d700ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 -- 172.21.15.37:0/1936468379 shutdown_connections 2023-10-06T04:17:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.120+0000 7f2d7597e700 1 -- 172.21.15.37:0/1936468379 wait complete. 2023-10-06T04:17:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.121+0000 7f2d7597e700 1 Processor -- start 2023-10-06T04:17:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.121+0000 7f2d7597e700 1 -- start start 2023-10-06T04:17:42.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 0x7f2d7016c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d7006d850 0x7f2d7016cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7016ad60 con 0x7f2d58004810 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7016aa80 con 0x7f2d7006d400 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700a5dd0 con 0x7f2d7006d850 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52480/0 (socket says 172.21.15.37:52480) 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 -- 172.21.15.37:0/4130852466 learned_addr learned my addr 172.21.15.37:0/4130852466 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6f7fe700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d7006d850 0x7f2d7016cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 0x7f2d7016c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 -- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d7006d850 msgr2=0x7f2d7016cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d7006d850 0x7f2d7016cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 -- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 msgr2=0x7f2d7016c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 0x7f2d7016c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 -- 172.21.15.37:0/4130852466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700a60b0 con 0x7f2d58004810 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 0x7f2d7016c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d6effd700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000fc30 tx=0x7f2d60009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600072e0 con 0x7f2d58004810 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60007440 con 0x7f2d58004810 2023-10-06T04:17:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700a6390 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.122+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600057f0 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.123+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d70169fd0 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.123+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70063410 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.124+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d60005b80 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.124+0000 7f2d56ffd700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 0x7f2d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.124+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d60084610 con 0x7f2d58004810 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.124+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 0x7f2d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.125+0000 7f2d6e7fc700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 0x7f2d5c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d640018b0 tx=0x7f2d64015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.128+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d60055500 con 0x7f2d58004810 2023-10-06T04:17:42.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.324+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2d70158e40 con 0x7f2d58004810 2023-10-06T04:17:42.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.324+0000 7f2d56ffd700 1 -- 172.21.15.37:0/4130852466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2d60055090 con 0x7f2d58004810 2023-10-06T04:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T04:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T04:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T04:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T04:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T04:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T04:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T04:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T04:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 msgr2=0x7f2d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 0x7f2d5c0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d640018b0 tx=0x7f2d64015000 comp rx=0 tx=0).stop 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 msgr2=0x7f2d7016af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000fc30 tx=0x7f2d60009040 comp rx=0 tx=0).stop 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 shutdown_connections 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d7006d850 0x7f2d7016cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d58004810 0x7f2d7016af60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f2d5c066f30 0x7f2d5c0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 --2- 172.21.15.37:0/4130852466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d7006d400 0x7f2d7016c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.326+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 >> 172.21.15.37:0/4130852466 conn(0x7f2d700ce470 msgr2=0x7f2d70159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.327+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 shutdown_connections 2023-10-06T04:17:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.327+0000 7f2d7597e700 1 -- 172.21.15.37:0/4130852466 wait complete. 2023-10-06T04:17:42.340 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:17:42.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:17:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 Processor -- start 2023-10-06T04:17:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 -- start start 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 0x7f16900c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16900cbb00 con 0x7f16900cd020 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16900cdc50 con 0x7f1690159da0 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.463+0000 7f1695f98700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16900cdf30 con 0x7f16900cf260 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16900cd020 0x7f16900cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47950/0 (socket says 172.21.15.37:47950) 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168ffff700 1 -- 172.21.15.37:0/2131536801 learned_addr learned my addr 172.21.15.37:0/2131536801 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168effd700 1 --2- 172.21.15.37:0/2131536801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 0x7f16900c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080750709 0 0) 0x7f16900cbb00 con 0x7f16900cd020 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1678003570 con 0x7f16900cd020 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288451528 0 0) 0x7f16900cdc50 con 0x7f1690159da0 2023-10-06T04:17:42.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16900cbb00 con 0x7f1690159da0 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168effd700 1 -- 172.21.15.37:0/2131536801 >> v1:172.21.15.83:6789/0 conn(0x7f1690159da0 legacy=0x7f16900ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428999771 0 0) 0x7f1678003570 con 0x7f16900cd020 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168effd700 1 -- 172.21.15.37:0/2131536801 >> v1:172.21.15.37:6789/0 conn(0x7f16900cd020 legacy=0x7f16900cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168effd700 1 -- 172.21.15.37:0/2131536801 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900cb790 con 0x7f16900cf260 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.464+0000 7f168effd700 1 --2- 172.21.15.37:0/2131536801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 0x7f16900c5410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1684009910 tx=0x7f16840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d47550cb7260582 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880017f0 con 0x7f16900cf260 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684011420 con 0x7f16900cf260 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f168e7fc700 1 -- 172.21.15.37:0/2131536801 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840117a0 con 0x7f16900cf260 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 -- 172.21.15.37:0/2131536801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 msgr2=0x7f16900c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 --2- 172.21.15.37:0/2131536801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 0x7f16900c5410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1684009910 tx=0x7f16840091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 -- 172.21.15.37:0/2131536801 shutdown_connections 2023-10-06T04:17:42.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 --2- 172.21.15.37:0/2131536801 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16900cf260 0x7f16900c5410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 -- 172.21.15.37:0/2131536801 >> 172.21.15.37:0/2131536801 conn(0x7f1690099aa0 msgr2=0x7f169006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:42.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 -- 172.21.15.37:0/2131536801 shutdown_connections 2023-10-06T04:17:42.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.465+0000 7f1695f98700 1 -- 172.21.15.37:0/2131536801 wait complete. 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.466+0000 7f1695f98700 1 Processor -- start 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.466+0000 7f1695f98700 1 -- start start 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 0x7f1690154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1690159da0 0x7f16900690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900ca720 con 0x7f16900cf260 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900b3410 con 0x7f16900cd020 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f1695f98700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16900b39d0 con 0x7f1690159da0 2023-10-06T04:17:42.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52492/0 (socket says 172.21.15.37:52492) 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 -- 172.21.15.37:0/1624664788 learned_addr learned my addr 172.21.15.37:0/1624664788 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168ffff700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1690159da0 0x7f16900690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168f7fe700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 0x7f1690154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 -- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1690159da0 msgr2=0x7f16900690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1690159da0 0x7f16900690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 -- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 msgr2=0x7f1690154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 0x7f1690154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168effd700 1 -- 172.21.15.37:0/1624664788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1684009420 con 0x7f16900cf260 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.467+0000 7f168f7fe700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 0x7f1690154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:42.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f168effd700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1684009f00 tx=0x7f1684016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168401caf0 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168401cc50 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16900b0bb0 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168401a450 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.468+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16900b3660 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.469+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1690063410 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.469+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f168401a880 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.469+0000 7f16777fe700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 0x7f167c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.470+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1684085d80 con 0x7f16900cf260 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.470+0000 7f168f7fe700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 0x7f167c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.470+0000 7f168f7fe700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 0x7f167c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16900ccb80 tx=0x7f1680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.474+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16840531e0 con 0x7f16900cf260 2023-10-06T04:17:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:42.667+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f16900b3b10 con 0x7f16900cf260 2023-10-06T04:17:43.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.004+0000 7f16777fe700 1 -- 172.21.15.37:0/1624664788 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1684056800 con 0x7f16900cf260 2023-10-06T04:17:43.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.007+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 msgr2=0x7f167c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.007+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 0x7f167c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16900ccb80 tx=0x7f1680009040 comp rx=0 tx=0).stop 2023-10-06T04:17:43.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.007+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 msgr2=0x7f1690068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.007+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1684009f00 tx=0x7f1684016000 comp rx=0 tx=0).stop 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 shutdown_connections 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1690159da0 0x7f16900690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f167c066f30 0x7f167c0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16900cd020 0x7f1690154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 --2- 172.21.15.37:0/1624664788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16900cf260 0x7f1690068b90 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1684009f00 tx=0x7f1684016000 comp rx=0 tx=0).stop 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 >> 172.21.15.37:0/1624664788 conn(0x7f1690099aa0 msgr2=0x7f16900cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.008+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 shutdown_connections 2023-10-06T04:17:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.009+0000 7f1695f98700 1 -- 172.21.15.37:0/1624664788 wait complete. 2023-10-06T04:17:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T04:17:43.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:17:43.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.151+0000 7fe92af58700 1 Processor -- start 2023-10-06T04:17:43.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.151+0000 7fe92af58700 1 -- start start 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe92af58700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe9240ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe92af58700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9240cdb20 con 0x7fe9240cf700 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe92af58700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9240c5430 con 0x7fe9240ce260 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe92af58700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240b3090 con 0x7fe924159dc0 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9294f5700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9240cf700 0x7fe9240c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47952/0 (socket says 172.21.15.37:47952) 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9294f5700 1 -- 172.21.15.37:0/2974133890 learned_addr learned my addr 172.21.15.37:0/2974133890 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe928cf4700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe9240ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728096882 0 0) 0x7fe9240cdb20 con 0x7fe9240cf700 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003570 con 0x7fe9240cf700 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442024967 0 0) 0x7fe914003570 con 0x7fe9240cf700 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 msgr2=0x7fe9240ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe9240ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 >> v1:172.21.15.83:6789/0 conn(0x7fe9240ce260 legacy=0x7fe9240ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.152+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240c6290 con 0x7fe9240cf700 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fe91c0017f0 con 0x7fe9240cf700 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 >> v1:172.21.15.37:6789/0 conn(0x7fe9240cf700 legacy=0x7fe9240c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe914003a90 0x7fe914003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe914004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240b3090 con 0x7fe914004d50 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400bb10 con 0x7fe914003a90 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91400bcd0 con 0x7fe924159dc0 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe928cf4700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe914003a90 0x7fe914003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe923fff700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe914004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 -- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 msgr2=0x7fe914004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe924159dc0 0x7fe914004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 -- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe914003a90 msgr2=0x7fe914003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe914003a90 0x7fe914003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 -- 172.21.15.37:0/2974133890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914003570 con 0x7fe914004d50 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9294f5700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe9240cfb00 tx=0x7fe91c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f13f44153af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0070d0 con 0x7fe914004d50 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c007230 con 0x7fe914004d50 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.153+0000 7fe9237fe700 1 -- 172.21.15.37:0/2974133890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0075f0 con 0x7fe914004d50 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 -- 172.21.15.37:0/2974133890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914004d50 msgr2=0x7fe9140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 --2- 172.21.15.37:0/2974133890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914004d50 0x7fe9140051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe9240cfb00 tx=0x7fe91c0021f0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe9294f5700 1 -- 172.21.15.37:0/2974133890 reap_dead start 2023-10-06T04:17:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 -- 172.21.15.37:0/2974133890 shutdown_connections 2023-10-06T04:17:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 -- 172.21.15.37:0/2974133890 >> 172.21.15.37:0/2974133890 conn(0x7fe924099a50 msgr2=0x7fe92406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 -- 172.21.15.37:0/2974133890 shutdown_connections 2023-10-06T04:17:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.154+0000 7fe92af58700 1 -- 172.21.15.37:0/2974133890 wait complete. 2023-10-06T04:17:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.155+0000 7fe92af58700 1 Processor -- start 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.155+0000 7fe92af58700 1 -- start start 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 0x7fe9240ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9240c8880 0x7fe9240c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240c83f0 con 0x7fe92409c2c0 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92409cbd0 con 0x7fe9240c8880 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe92af58700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240c77e0 con 0x7fe9240ca090 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52512/0 (socket says 172.21.15.37:52512) 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 -- 172.21.15.37:0/4065098435 learned_addr learned my addr 172.21.15.37:0/4065098435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe923fff700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 0x7fe9240ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe9294f5700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9240c8880 0x7fe9240c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 -- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 msgr2=0x7fe9240ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 0x7fe9240ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 -- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9240c8880 msgr2=0x7fe9240c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9240c8880 0x7fe9240c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe928cf4700 1 -- 172.21.15.37:0/4065098435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240c7ac0 con 0x7fe92409c2c0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.156+0000 7fe923fff700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 0x7fe9240ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe928cf4700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe918011b10 tx=0x7fe918009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918005c10 con 0x7fe92409c2c0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918005d70 con 0x7fe92409c2c0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800fa10 con 0x7fe92409c2c0 2023-10-06T04:17:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9240c7da0 con 0x7fe92409c2c0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.157+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe924156f30 con 0x7fe92409c2c0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.158+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9240c86d0 con 0x7fe92409c2c0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.158+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe918006050 con 0x7fe92409c2c0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.159+0000 7fe920ff9700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.159+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fe918084f80 con 0x7fe92409c2c0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.159+0000 7fe923fff700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.160+0000 7fe923fff700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe910007ba0 tx=0x7fe910009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.163+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9180521d0 con 0x7fe92409c2c0 2023-10-06T04:17:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:43.357+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe9240c8240 con 0x7fe92409c2c0 2023-10-06T04:17:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.014+0000 7fe920ff9700 1 -- 172.21.15.37:0/4065098435 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe9180210d0 con 0x7fe92409c2c0 2023-10-06T04:17:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.020+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 msgr2=0x7fe9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.020+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 0x7fe9080693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe910007ba0 tx=0x7fe910009040 comp rx=0 tx=0).stop 2023-10-06T04:17:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.020+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 msgr2=0x7fe92409c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.020+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe918011b10 tx=0x7fe918009120 comp rx=0 tx=0).stop 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 shutdown_connections 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fe908066f30 0x7fe9080693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9240c8880 0x7fe9240c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe92409c2c0 0x7fe92409c690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 --2- 172.21.15.37:0/4065098435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9240ca090 0x7fe9240ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 >> 172.21.15.37:0/4065098435 conn(0x7fe924099a50 msgr2=0x7fe9240cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.027+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 shutdown_connections 2023-10-06T04:17:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.028+0000 7fe92af58700 1 -- 172.21.15.37:0/4065098435 wait complete. 2023-10-06T04:17:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T04:17:44.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:17:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.171+0000 7f18684ca700 1 Processor -- start 2023-10-06T04:17:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.171+0000 7f18684ca700 1 -- start start 2023-10-06T04:17:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.172+0000 7f18684ca700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186006bd40 0x7f186015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.172+0000 7f18684ca700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f186006a040 0x7f18600b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.172+0000 7f18684ca700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186015dd80 con 0x7f18600b1990 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.172+0000 7f18684ca700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186015db70 con 0x7f186006a040 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.172+0000 7f18684ca700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1860068aa0 con 0x7f186006bd40 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866a67700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18600b1990 0x7f18600692e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47968/0 (socket says 172.21.15.37:47968) 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866a67700 1 -- 172.21.15.37:0/85924252 learned_addr learned my addr 172.21.15.37:0/85924252 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186006bd40 0x7f186015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865a65700 1 --2- 172.21.15.37:0/85924252 >> v2:172.21.15.83:3300/0 conn(0x7f186006a040 0x7f18600b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787497656 0 0) 0x7f186015dd80 con 0x7f18600b1990 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1848003570 con 0x7f18600b1990 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135853600 0 0) 0x7f1848003570 con 0x7f18600b1990 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186006bd40 msgr2=0x7f186015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186006bd40 0x7f186015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 >> v2:172.21.15.83:3300/0 conn(0x7f186006a040 msgr2=0x7f18600b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 --2- 172.21.15.37:0/85924252 >> v2:172.21.15.83:3300/0 conn(0x7f186006a040 0x7f18600b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186015e060 con 0x7f18600b1990 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f18500017f0 con 0x7f18600b1990 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 >> v1:172.21.15.37:6789/0 conn(0x7f18600b1990 legacy=0x7f18600692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1848003a60 0x7f1848003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848004810 0x7f1848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18480051c0 0x7f184800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186015db70 con 0x7f1848003a60 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860068aa0 con 0x7f1848004810 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184800bfa0 con 0x7f18480051c0 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186006bd40 0x7f186015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1865a65700 1 --2- 172.21.15.37:0/85924252 >> v2:172.21.15.83:3300/0 conn(0x7f186006a040 0x7f18600b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1848003a60 0x7f1848003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.173+0000 7f1866a67700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18480051c0 0x7f184800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1865a65700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848004810 0x7f1848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 -- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18480051c0 msgr2=0x7f184800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18480051c0 0x7f184800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 -- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848004810 msgr2=0x7f1848004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848004810 0x7f1848004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 -- 172.21.15.37:0/85924252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848003570 con 0x7f1848003a60 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1866266700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1848003a60 0x7f1848003e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f18600cc160 tx=0x7f18580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f3c58db68f2da1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800e710 con 0x7f1848003a60 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800e870 con 0x7f1848003a60 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.174+0000 7f1865264700 1 -- 172.21.15.37:0/85924252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800ec10 con 0x7f1848003a60 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 -- 172.21.15.37:0/85924252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1848003a60 msgr2=0x7f1848003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 --2- 172.21.15.37:0/85924252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1848003a60 0x7f1848003e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f18600cc160 tx=0x7f18580091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f1866a67700 1 -- 172.21.15.37:0/85924252 reap_dead start 2023-10-06T04:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 -- 172.21.15.37:0/85924252 shutdown_connections 2023-10-06T04:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 -- 172.21.15.37:0/85924252 >> 172.21.15.37:0/85924252 conn(0x7f18600ce680 msgr2=0x7f18600cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 -- 172.21.15.37:0/85924252 shutdown_connections 2023-10-06T04:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.175+0000 7f18684ca700 1 -- 172.21.15.37:0/85924252 wait complete. 2023-10-06T04:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.176+0000 7f18684ca700 1 Processor -- start 2023-10-06T04:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.176+0000 7f18684ca700 1 -- start start 2023-10-06T04:17:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.176+0000 7f18684ca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848003a60 0x7f18600c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.176+0000 7f18684ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186015bb00 0x7f18600aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600aaca0 con 0x7f18600c6da0 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600c6910 con 0x7f1848003a60 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600c5d00 con 0x7f186015bb00 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52534/0 (socket says 172.21.15.37:52534) 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 -- 172.21.15.37:0/2923201790 learned_addr learned my addr 172.21.15.37:0/2923201790 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1866a67700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186015bb00 0x7f18600aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1866266700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848003a60 0x7f18600c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 -- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186015bb00 msgr2=0x7f18600aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186015bb00 0x7f18600aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 -- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848003a60 msgr2=0x7f18600c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848003a60 0x7f18600c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 -- 172.21.15.37:0/2923201790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600c5fe0 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f1865a65700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1854011d70 tx=0x7f18540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011e70 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400fc20 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600c62c0 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854014440 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.177+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186015bf70 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.178+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18600c6aa0 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.179+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1854014830 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.179+0000 7f185e7fc700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.179+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f1854018030 con 0x7f18600c6da0 2023-10-06T04:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.179+0000 7f1866266700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.180+0000 7f1866266700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 0x7f184c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18580091e0 tx=0x7f1858019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.184+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1854052260 con 0x7f18600c6da0 2023-10-06T04:17:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:44.422+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f186015c190 con 0x7f18600c6da0 2023-10-06T04:17:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.015+0000 7f185e7fc700 1 -- 172.21.15.37:0/2923201790 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18540220c0 con 0x7f18600c6da0 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 msgr2=0x7f184c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 0x7f184c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18580091e0 tx=0x7f1858019000 comp rx=0 tx=0).stop 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 msgr2=0x7f18600c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1854011d70 tx=0x7f18540091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 shutdown_connections 2023-10-06T04:17:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f186015bb00 0x7f18600aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1848003a60 0x7f18600c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 --2- 172.21.15.37:0/2923201790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18600c6da0 0x7f18600c5690 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.019+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 >> 172.21.15.37:0/2923201790 conn(0x7f18600ce680 msgr2=0x7f18600b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.020+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 shutdown_connections 2023-10-06T04:17:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.020+0000 7f18684ca700 1 -- 172.21.15.37:0/2923201790 wait complete. 2023-10-06T04:17:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T04:17:45.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.159+0000 7fea76096700 1 Processor -- start 2023-10-06T04:17:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.159+0000 7fea76096700 1 -- start start 2023-10-06T04:17:45.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea76096700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea700ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea76096700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea700ae9f0 con 0x7fea700b5e30 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea76096700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea700adde0 con 0x7fea700b6200 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea76096700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea700ae0c0 con 0x7fea7015dc70 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea6f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea700b5e30 0x7fea7015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47974/0 (socket says 172.21.15.37:47974) 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.160+0000 7fea6f7fe700 1 -- 172.21.15.37:0/104532052 learned_addr learned my addr 172.21.15.37:0/104532052 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea700ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696555054 0 0) 0x7fea700ae9f0 con 0x7fea700b5e30 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003570 con 0x7fea700b5e30 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932241025 0 0) 0x7fea58003570 con 0x7fea700b5e30 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 msgr2=0x7fea700ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea700ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 >> v1:172.21.15.83:6789/0 conn(0x7fea700b6200 legacy=0x7fea700ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700ae3a0 con 0x7fea700b5e30 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fea60001470 con 0x7fea700b5e30 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 >> v1:172.21.15.37:6789/0 conn(0x7fea700b5e30 legacy=0x7fea7015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58003a90 0x7fea58003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea58004810 0x7fea58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea58005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea700ae0c0 con 0x7fea58004810 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5800bb90 con 0x7fea58003a90 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5800bd50 con 0x7fea7015dc70 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea58004810 0x7fea58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6f7fe700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58003a90 0x7fea58003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6ffff700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea58005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 -- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 msgr2=0x7fea58005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea58005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 -- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58003a90 msgr2=0x7fea58003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58003a90 0x7fea58003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6effd700 1 -- 172.21.15.37:0/104532052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58003570 con 0x7fea58004810 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.161+0000 7fea6ffff700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7015dc70 0x7fea58005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea6effd700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea58004810 0x7fea58004c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fea64009c00 tx=0x7fea640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c30df60686fb46f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400e710 con 0x7fea58004810 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400e870 con 0x7fea58004810 2023-10-06T04:17:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea6e7fc700 1 -- 172.21.15.37:0/104532052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400ec30 con 0x7fea58004810 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 -- 172.21.15.37:0/104532052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea58004810 msgr2=0x7fea58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 --2- 172.21.15.37:0/104532052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea58004810 0x7fea58004c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fea64009c00 tx=0x7fea640091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea6ffff700 1 -- 172.21.15.37:0/104532052 reap_dead start 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 -- 172.21.15.37:0/104532052 shutdown_connections 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 -- 172.21.15.37:0/104532052 >> 172.21.15.37:0/104532052 conn(0x7fea70099a10 msgr2=0x7fea7006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 -- 172.21.15.37:0/104532052 shutdown_connections 2023-10-06T04:17:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.162+0000 7fea76096700 1 -- 172.21.15.37:0/104532052 wait complete. 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.163+0000 7fea76096700 1 Processor -- start 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 -- start start 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58004810 0x7fea7016b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7016cf60 0x7fea700c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea700c6660 con 0x7fea7016ae70 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7009b1e0 con 0x7fea58004810 2023-10-06T04:17:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea76096700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7009b4c0 con 0x7fea7016cf60 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52564/0 (socket says 172.21.15.37:52564) 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea6effd700 1 -- 172.21.15.37:0/2261603851 learned_addr learned my addr 172.21.15.37:0/2261603851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea6f7fe700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58004810 0x7fea7016b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.164+0000 7fea6ffff700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7016cf60 0x7fea700c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 -- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7016cf60 msgr2=0x7fea700c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7016cf60 0x7fea700c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 -- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58004810 msgr2=0x7fea7016b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58004810 0x7fea7016b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 -- 172.21.15.37:0/2261603851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7009b7a0 con 0x7fea7016ae70 2023-10-06T04:17:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea6effd700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea5800bb60 tx=0x7fea6401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64022070 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400ebf0 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7009ba80 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6401c6a0 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.165+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7016d3b0 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.166+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea700b2f90 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.166+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea6401ca90 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.167+0000 7fea577fe700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.167+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea64085e50 con 0x7fea7016ae70 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.167+0000 7fea6f7fe700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.167+0000 7fea6f7fe700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 0x7fea5c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea600015a0 tx=0x7fea60001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.171+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea64053020 con 0x7fea7016ae70 2023-10-06T04:17:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.365+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea700c6660 con 0x7fea7016ae70 2023-10-06T04:17:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.366+0000 7fea577fe700 1 -- 172.21.15.37:0/2261603851 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16831 (secure 0 0 0) 0x7fea6402b090 con 0x7fea7016ae70 2023-10-06T04:17:45.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:45.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:17:44.423440+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 msgr2=0x7fea5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 0x7fea5c0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea600015a0 tx=0x7fea60001e70 comp rx=0 tx=0).stop 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 msgr2=0x7fea700c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea5800bb60 tx=0x7fea6401a000 comp rx=0 tx=0).stop 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 shutdown_connections 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fea7016cf60 0x7fea700c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fea5c066f30 0x7fea5c0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fea58004810 0x7fea7016b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 --2- 172.21.15.37:0/2261603851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7016ae70 0x7fea700c5e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 >> 172.21.15.37:0/2261603851 conn(0x7fea70099a10 msgr2=0x7fea70068690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 shutdown_connections 2023-10-06T04:17:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.368+0000 7fea76096700 1 -- 172.21.15.37:0/2261603851 wait complete. 2023-10-06T04:17:45.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.500+0000 7f084c612700 1 Processor -- start 2023-10-06T04:17:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.500+0000 7f084c612700 1 -- start start 2023-10-06T04:17:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084c612700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 0x7f08440b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084c612700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084c612700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440ab500 con 0x7f08440b3430 2023-10-06T04:17:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084c612700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440b6550 con 0x7f0844159950 2023-10-06T04:17:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084c612700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b1cc0 con 0x7f08440b4100 2023-10-06T04:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084a3ae700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 0x7f08440b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:60348/0 (socket says 172.21.15.37:60348) 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 -- 172.21.15.37:0/3610893576 learned_addr learned my addr 172.21.15.37:0/3610893576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 -- 172.21.15.37:0/3610893576 >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 msgr2=0x7f08440b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 --2- 172.21.15.37:0/3610893576 >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 0x7f08440b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 -- 172.21.15.37:0/3610893576 >> v1:172.21.15.83:6789/0 conn(0x7f08440b3430 legacy=0x7f0844159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084abaf700 1 -- 172.21.15.37:0/3610893576 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440b4a70 con 0x7f08440b4100 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.501+0000 7f084a3ae700 1 --2- 172.21.15.37:0/3610893576 >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 0x7f08440b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084abaf700 1 --2- 172.21.15.37:0/3610893576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f083c009f20 tx=0x7f083c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4e943d90951e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f08493ac700 1 -- 172.21.15.37:0/3610893576 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00e070 con 0x7f08440b4100 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f08493ac700 1 -- 172.21.15.37:0/3610893576 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00b9d0 con 0x7f08440b4100 2023-10-06T04:17:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f08493ac700 1 -- 172.21.15.37:0/3610893576 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0092e0 con 0x7f08440b4100 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 -- 172.21.15.37:0/3610893576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 msgr2=0x7f08440b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 --2- 172.21.15.37:0/3610893576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f083c009f20 tx=0x7f083c009840 comp rx=0 tx=0).stop 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 -- 172.21.15.37:0/3610893576 shutdown_connections 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 --2- 172.21.15.37:0/3610893576 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b4100 0x7f08440b4530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 --2- 172.21.15.37:0/3610893576 >> v2:172.21.15.83:3300/0 conn(0x7f0844159950 0x7f08440b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 -- 172.21.15.37:0/3610893576 >> 172.21.15.37:0/3610893576 conn(0x7f0844099a10 msgr2=0x7f084406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 -- 172.21.15.37:0/3610893576 shutdown_connections 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.502+0000 7f084c612700 1 -- 172.21.15.37:0/3610893576 wait complete. 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.503+0000 7f084c612700 1 Processor -- start 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 -- start start 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b3430 0x7f084409b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0844159950 0x7f0844156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084409b7e0 con 0x7f08440b4100 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084409dff0 con 0x7f0844159950 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084c612700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440adea0 con 0x7f08440b3430 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f0849bad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f0849bad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52568/0 (socket says 172.21.15.37:52568) 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f0849bad700 1 -- 172.21.15.37:0/1227020339 learned_addr learned my addr 172.21.15.37:0/1227020339 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.504+0000 7f084a3ae700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b3430 0x7f084409b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f084abaf700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0844159950 0x7f0844156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 -- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b3430 msgr2=0x7f084409b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b3430 0x7f084409b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 -- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0844159950 msgr2=0x7f0844156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0844159950 0x7f0844156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 -- 172.21.15.37:0/1227020339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009420 con 0x7f08440b4100 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f0849bad700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f083800c4e0 tx=0x7f083800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838011590 con 0x7f08440b4100 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838011710 con 0x7f08440b4100 2023-10-06T04:17:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c009ae0 con 0x7f08440b4100 2023-10-06T04:17:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838011ad0 con 0x7f08440b4100 2023-10-06T04:17:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.505+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440ae460 con 0x7f08440b4100 2023-10-06T04:17:45.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.506+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844063410 con 0x7f08440b4100 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.507+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0838001020 con 0x7f08440b4100 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.507+0000 7f08427fc700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 0x7f08300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.507+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0838083980 con 0x7f08440b4100 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.507+0000 7f084a3ae700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 0x7f08300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.508+0000 7f084a3ae700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 0x7f08300693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0834009f40 tx=0x7f08340091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.511+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0838050a90 con 0x7f08440b4100 2023-10-06T04:17:45.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.709+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f084408a710 con 0x7f08440b4100 2023-10-06T04:17:45.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.709+0000 7f08427fc700 1 -- 172.21.15.37:0/1227020339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f0838017070 con 0x7f08440b4100 2023-10-06T04:17:45.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:45.711 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:17:45.688418+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 msgr2=0x7f08300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 0x7f08300693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0834009f40 tx=0x7f08340091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 msgr2=0x7f0844155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f083800c4e0 tx=0x7f083800c7f0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 shutdown_connections 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0830066f30 0x7f08300693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0844159950 0x7f0844156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08440b3430 0x7f084409b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 --2- 172.21.15.37:0/1227020339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08440b4100 0x7f0844155ce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 >> 172.21.15.37:0/1227020339 conn(0x7f0844099a10 msgr2=0x7f08440cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 shutdown_connections 2023-10-06T04:17:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.712+0000 7f084c612700 1 -- 172.21.15.37:0/1227020339 wait complete. 2023-10-06T04:17:45.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.847+0000 7f73932f4700 1 Processor -- start 2023-10-06T04:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.847+0000 7f73932f4700 1 -- start start 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.847+0000 7f73932f4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f738c159dc0 0x7f738c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f73932f4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 0x7f738c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f73932f4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c0cdb20 con 0x7f738c0ce260 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f73932f4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0b3090 con 0x7f738c159dc0 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f73932f4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0c5430 con 0x7f738c0cf700 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f738c159dc0 0x7f738c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f739088f700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f738c0ce260 0x7f738c0ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47990/0 (socket says 172.21.15.37:47990) 2023-10-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f738c159dc0 0x7f738c0ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52580/0 (socket says 172.21.15.37:52580) 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f739088f700 1 -- 172.21.15.37:0/4069679284 learned_addr learned my addr 172.21.15.37:0/4069679284 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391891700 1 --2- 172.21.15.37:0/4069679284 >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 0x7f738c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 -- 172.21.15.37:0/4069679284 >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 msgr2=0x7f738c0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 --2- 172.21.15.37:0/4069679284 >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 0x7f738c0cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 -- 172.21.15.37:0/4069679284 >> v1:172.21.15.37:6789/0 conn(0x7f738c0ce260 legacy=0x7f738c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 -- 172.21.15.37:0/4069679284 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0c6290 con 0x7f738c159dc0 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391891700 1 --2- 172.21.15.37:0/4069679284 >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 0x7f738c0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f7391090700 1 --2- 172.21.15.37:0/4069679284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c0ad140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f738c089b80 tx=0x7f7384009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a94c7f7117cec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f738bfff700 1 -- 172.21.15.37:0/4069679284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400e070 con 0x7f738c159dc0 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f738bfff700 1 -- 172.21.15.37:0/4069679284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400bc30 con 0x7f738c159dc0 2023-10-06T04:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.848+0000 7f738bfff700 1 -- 172.21.15.37:0/4069679284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384012430 con 0x7f738c159dc0 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 -- 172.21.15.37:0/4069679284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 msgr2=0x7f738c0ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 --2- 172.21.15.37:0/4069679284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c0ad140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f738c089b80 tx=0x7f7384009780 comp rx=0 tx=0).stop 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 -- 172.21.15.37:0/4069679284 shutdown_connections 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 --2- 172.21.15.37:0/4069679284 >> v2:172.21.15.83:3300/0 conn(0x7f738c0cf700 0x7f738c0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 --2- 172.21.15.37:0/4069679284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c0ad140 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 -- 172.21.15.37:0/4069679284 >> 172.21.15.37:0/4069679284 conn(0x7f738c099a50 msgr2=0x7f738c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 -- 172.21.15.37:0/4069679284 shutdown_connections 2023-10-06T04:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.849+0000 7f73932f4700 1 -- 172.21.15.37:0/4069679284 wait complete. 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.850+0000 7f73932f4700 1 Processor -- start 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.850+0000 7f73932f4700 1 -- start start 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f738c0ce260 0x7f738c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738c0cf700 0x7f738c09dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c84f0 con 0x7f738c159dc0 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c78e0 con 0x7f738c0cf700 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f73932f4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c7bc0 con 0x7f738c0ce260 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52594/0 (socket says 172.21.15.37:52594) 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 -- 172.21.15.37:0/1277432473 learned_addr learned my addr 172.21.15.37:0/1277432473 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f739088f700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738c0cf700 0x7f738c09dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391090700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f738c0ce260 0x7f738c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 -- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f738c0ce260 msgr2=0x7f738c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f738c0ce260 0x7f738c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 -- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738c0cf700 msgr2=0x7f738c09dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738c0cf700 0x7f738c09dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 -- 172.21.15.37:0/1277432473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009a20 con 0x7f738c159dc0 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.851+0000 7f7391891700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f737c00e870 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.852+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c013410 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.852+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c013570 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.852+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c013910 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.852+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0c7ea0 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.852+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c09e160 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.853+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0c8630 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.853+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f737c013cc0 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.853+0000 7f73897fa700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.854+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f737c0847c0 con 0x7f738c159dc0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.854+0000 7f7391090700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.854+0000 7f7391090700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 0x7f73780693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f738c089b80 tx=0x7f7384019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:45.858+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f738c0c8630 con 0x7f738c159dc0 2023-10-06T04:17:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:46.101+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f738c0c8630 con 0x7f738c159dc0 2023-10-06T04:17:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.039+0000 7f73897fa700 1 -- 172.21.15.37:0/1277432473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f738c0c8630 con 0x7f738c159dc0 2023-10-06T04:17:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.041+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 msgr2=0x7f73780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.041+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 0x7f73780693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f738c089b80 tx=0x7f7384019000 comp rx=0 tx=0).stop 2023-10-06T04:17:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 msgr2=0x7f738c09b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f737c00e870 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 shutdown_connections 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c159dc0 0x7f738c09b4b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f738c0ce260 0x7f738c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7378066f30 0x7f73780693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 --2- 172.21.15.37:0/1277432473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f738c0cf700 0x7f738c09dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 >> 172.21.15.37:0/1277432473 conn(0x7f738c099a50 msgr2=0x7f738c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 shutdown_connections 2023-10-06T04:17:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.042+0000 7f73932f4700 1 -- 172.21.15.37:0/1277432473 wait complete. 2023-10-06T04:17:47.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:17:47.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.187+0000 7fbf556d6700 1 Processor -- start 2023-10-06T04:17:47.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.187+0000 7fbf556d6700 1 -- start start 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf556d6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 0x7fbf500ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf556d6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf556d6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500cdb20 con 0x7fbf500cf530 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf556d6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf500cf9d0 con 0x7fbf50159dc0 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf556d6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500b3090 con 0x7fbf500ce260 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.188+0000 7fbf4e7fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:49206/0 (socket says 172.21.15.37:49206) 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/1475055735 learned_addr learned my addr 172.21.15.37:0/1475055735 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4effd700 1 --2- 172.21.15.37:0/1475055735 >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 0x7fbf500ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4f7fe700 1 --1- 172.21.15.37:0/1475055735 >> v1:172.21.15.83:6789/0 conn(0x7fbf500cf530 0x7fbf500c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:36668/0 (socket says 172.21.15.37:36668) 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4dffb700 1 -- 172.21.15.37:0/1475055735 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763369233 0 0) 0x7fbf500cdb20 con 0x7fbf500cf530 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4dffb700 1 -- 172.21.15.37:0/1475055735 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf3c003570 con 0x7fbf500cf530 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/1475055735 >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 msgr2=0x7fbf500ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 --2- 172.21.15.37:0/1475055735 >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 0x7fbf500ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/1475055735 >> v1:172.21.15.83:6789/0 conn(0x7fbf500cf530 legacy=0x7fbf500c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/1475055735 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500c5430 con 0x7fbf500ce260 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4effd700 1 --2- 172.21.15.37:0/1475055735 >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 0x7fbf500ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4e7fc700 1 --2- 172.21.15.37:0/1475055735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf380099b0 tx=0x7fbf38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc5553c8da8d8599 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4dffb700 1 -- 172.21.15.37:0/1475055735 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800b680 con 0x7fbf500ce260 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4dffb700 1 -- 172.21.15.37:0/1475055735 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800b7e0 con 0x7fbf500ce260 2023-10-06T04:17:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.189+0000 7fbf4dffb700 1 -- 172.21.15.37:0/1475055735 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800bb80 con 0x7fbf500ce260 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 -- 172.21.15.37:0/1475055735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 msgr2=0x7fbf500ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 --2- 172.21.15.37:0/1475055735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf380099b0 tx=0x7fbf38009250 comp rx=0 tx=0).stop 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 -- 172.21.15.37:0/1475055735 shutdown_connections 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 --2- 172.21.15.37:0/1475055735 >> v2:172.21.15.83:3300/0 conn(0x7fbf50159dc0 0x7fbf500ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 --2- 172.21.15.37:0/1475055735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf500ceff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 -- 172.21.15.37:0/1475055735 >> 172.21.15.37:0/1475055735 conn(0x7fbf50099a50 msgr2=0x7fbf5006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 -- 172.21.15.37:0/1475055735 shutdown_connections 2023-10-06T04:17:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.190+0000 7fbf556d6700 1 -- 172.21.15.37:0/1475055735 wait complete. 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.191+0000 7fbf556d6700 1 Processor -- start 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.191+0000 7fbf556d6700 1 -- start start 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf50157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf50159dc0 0x7fbf501582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5009ae00 con 0x7fbf500cf530 2023-10-06T04:17:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5009b0e0 con 0x7fbf50159dc0 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf556d6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5009b3c0 con 0x7fbf500ce260 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf4e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf4e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45572/0 (socket says 172.21.15.37:45572) 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/835577105 learned_addr learned my addr 172.21.15.37:0/835577105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf4effd700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf50157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.192+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 msgr2=0x7fbf50157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf4e7fc700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf50157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf50159dc0 msgr2=0x7fbf501582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf4e7fc700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf50159dc0 0x7fbf501582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf4e7fc700 1 -- 172.21.15.37:0/835577105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40009a20 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf4e7fc700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fd0 tx=0x7fbf38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800b950 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800bab0 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3801a660 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf380094f0 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.193+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf50169af0 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.194+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf50169d40 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.194+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf3801aa90 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.195+0000 7fbf46ffd700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.195+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf380863d0 con 0x7fbf500cf530 2023-10-06T04:17:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.195+0000 7fbf4effd700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.196+0000 7fbf4effd700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 0x7fbf300693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf400099f0 tx=0x7fbf4000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.199+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf38053440 con 0x7fbf500cf530 2023-10-06T04:17:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:47.436+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbf5004c3c0 con 0x7fbf500cf530 2023-10-06T04:17:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.046+0000 7fbf46ffd700 1 -- 172.21.15.37:0/835577105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbf38056a60 con 0x7fbf500cf530 2023-10-06T04:17:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 msgr2=0x7fbf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 0x7fbf300693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf400099f0 tx=0x7fbf4000b040 comp rx=0 tx=0).stop 2023-10-06T04:17:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 msgr2=0x7fbf50157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fd0 tx=0x7fbf38017000 comp rx=0 tx=0).stop 2023-10-06T04:17:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 shutdown_connections 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbf50159dc0 0x7fbf501582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbf500ce260 0x7fbf50157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 --2- 172.21.15.37:0/835577105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf500cf530 0x7fbf50157db0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 >> 172.21.15.37:0/835577105 conn(0x7fbf50099a50 msgr2=0x7fbf500b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 shutdown_connections 2023-10-06T04:17:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.048+0000 7fbf556d6700 1 -- 172.21.15.37:0/835577105 wait complete. 2023-10-06T04:17:48.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.185+0000 7f5383639700 1 Processor -- start 2023-10-06T04:17:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 -- start start 2023-10-06T04:17:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0cb030 0x7f537c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0a98e0 0x7f537c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0cb940 con 0x7f537c0c75b0 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0c7d80 con 0x7f537c0cb030 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f5383639700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c067660 con 0x7f537c0a98e0 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.186+0000 7f53813d5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0cb030 0x7f537c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0cb030 0x7f537c0cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45588/0 (socket says 172.21.15.37:45588) 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 -- 172.21.15.37:0/1134796478 learned_addr learned my addr 172.21.15.37:0/1134796478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f5380bd4700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0a98e0 0x7f537c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 -- 172.21.15.37:0/1134796478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0a98e0 msgr2=0x7f537c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0a98e0 0x7f537c0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 -- 172.21.15.37:0/1134796478 >> v1:172.21.15.83:6789/0 conn(0x7f537c0c75b0 legacy=0x7f537c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 -- 172.21.15.37:0/1134796478 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c067f00 con 0x7f537c0cb030 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f53813d5700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0cb030 0x7f537c0cb400 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53740099b0 tx=0x7f5374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbe89b2cd8b1b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f537bfff700 1 -- 172.21.15.37:0/1134796478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400b820 con 0x7f537c0cb030 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f537bfff700 1 -- 172.21.15.37:0/1134796478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400b980 con 0x7f537c0cb030 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.187+0000 7f537bfff700 1 -- 172.21.15.37:0/1134796478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400bd20 con 0x7f537c0cb030 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 -- 172.21.15.37:0/1134796478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0cb030 msgr2=0x7f537c0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0cb030 0x7f537c0cb400 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53740099b0 tx=0x7f5374009250 comp rx=0 tx=0).stop 2023-10-06T04:17:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 -- 172.21.15.37:0/1134796478 shutdown_connections 2023-10-06T04:17:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0cb030 0x7f537c0cb400 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 --2- 172.21.15.37:0/1134796478 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0a98e0 0x7f537c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 -- 172.21.15.37:0/1134796478 >> 172.21.15.37:0/1134796478 conn(0x7f537c0c9540 msgr2=0x7f537c0c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 -- 172.21.15.37:0/1134796478 shutdown_connections 2023-10-06T04:17:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.188+0000 7f5383639700 1 -- 172.21.15.37:0/1134796478 wait complete. 2023-10-06T04:17:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.189+0000 7f5383639700 1 Processor -- start 2023-10-06T04:17:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.189+0000 7f5383639700 1 -- start start 2023-10-06T04:17:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 0x7f537c0c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0cb030 0x7f537c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c146880 con 0x7f537c0a98e0 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0c6a50 con 0x7f537c0c75b0 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5383639700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0c6d30 con 0x7f537c0cb030 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45594/0 (socket says 172.21.15.37:45594) 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 -- 172.21.15.37:0/1255270855 learned_addr learned my addr 172.21.15.37:0/1255270855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5381bd6700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0cb030 0x7f537c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5380bd4700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 0x7f537c0c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 -- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0cb030 msgr2=0x7f537c0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0cb030 0x7f537c0c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 -- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 msgr2=0x7f537c0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 0x7f537c0c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 -- 172.21.15.37:0/1255270855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740094f0 con 0x7f537c0a98e0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f5380bd4700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 0x7f537c0c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.190+0000 7f53813d5700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5374009290 tx=0x7f5374016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.191+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011ca0 con 0x7f537c0a98e0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.191+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374020070 con 0x7f537c0a98e0 2023-10-06T04:17:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.191+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0c7010 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.191+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537401b6a0 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.191+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0ad280 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.192+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c070630 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.192+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5374022030 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.192+0000 7f53797fa700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.192+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5374086460 con 0x7f537c0a98e0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.193+0000 7f5380bd4700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.193+0000 7f5380bd4700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 0x7f53680693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5370006fd0 tx=0x7f5370008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.197+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5374053570 con 0x7f537c0a98e0 2023-10-06T04:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.441+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f537c070630 con 0x7f537c0a98e0 2023-10-06T04:17:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.442+0000 7f53797fa700 1 -- 172.21.15.37:0/1255270855 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f5374056b90 con 0x7f537c0a98e0 2023-10-06T04:17:48.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:48.444 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:17:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 msgr2=0x7f53680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 0x7f53680693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5370006fd0 tx=0x7f5370008040 comp rx=0 tx=0).stop 2023-10-06T04:17:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 msgr2=0x7f537c146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5374009290 tx=0x7f5374016000 comp rx=0 tx=0).stop 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 shutdown_connections 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f537c0cb030 0x7f537c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0a98e0 0x7f537c146340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5368066f30 0x7f53680693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 --2- 172.21.15.37:0/1255270855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f537c0c75b0 0x7f537c0c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 >> 172.21.15.37:0/1255270855 conn(0x7f537c0c9540 msgr2=0x7f537c158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 shutdown_connections 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.444+0000 7f5383639700 1 -- 172.21.15.37:0/1255270855 wait complete. 2023-10-06T04:17:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:17:48.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:17:48.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.575+0000 7eff2b045700 1 Processor -- start 2023-10-06T04:17:48.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.575+0000 7eff2b045700 1 -- start start 2023-10-06T04:17:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2b045700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff240b2810 0x7eff240cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2b045700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 0x7eff2415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2b045700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff240cfa20 con 0x7eff240ce780 2023-10-06T04:17:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2b045700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff240cec20 con 0x7eff240b2810 2023-10-06T04:17:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2b045700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff24159b40 con 0x7eff240cd2c0 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a043700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff240b2810 0x7eff240cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a844700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 0x7eff2415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff29842700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7eff240ce780 0x7eff240ccbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:36686/0 (socket says 172.21.15.37:36686) 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff29842700 1 -- 172.21.15.37:0/4008879161 learned_addr learned my addr 172.21.15.37:0/4008879161 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a043700 1 -- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 msgr2=0x7eff2415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a043700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 0x7eff2415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a043700 1 -- 172.21.15.37:0/4008879161 >> v1:172.21.15.83:6789/0 conn(0x7eff240ce780 legacy=0x7eff240ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a043700 1 -- 172.21.15.37:0/4008879161 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2415e140 con 0x7eff240b2810 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff29041700 1 -- 172.21.15.37:0/4008879161 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155957406 0 0) 0x7eff240cfa20 con 0x7eff240ce780 2023-10-06T04:17:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.576+0000 7eff2a844700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 0x7eff2415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2a043700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240b2810 0x7eff240cfeb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e60 tx=0x7eff14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5cd5284fe96a0b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff29041700 1 -- 172.21.15.37:0/4008879161 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e070 con 0x7eff240b2810 2023-10-06T04:17:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff29041700 1 -- 172.21.15.37:0/4008879161 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400bb60 con 0x7eff240b2810 2023-10-06T04:17:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff29041700 1 -- 172.21.15.37:0/4008879161 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012430 con 0x7eff240b2810 2023-10-06T04:17:48.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 -- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240b2810 msgr2=0x7eff240cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240b2810 0x7eff240cfeb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e60 tx=0x7eff14009780 comp rx=0 tx=0).stop 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 -- 172.21.15.37:0/4008879161 shutdown_connections 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240cd2c0 0x7eff2415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 --2- 172.21.15.37:0/4008879161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240b2810 0x7eff240cfeb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 -- 172.21.15.37:0/4008879161 >> 172.21.15.37:0/4008879161 conn(0x7eff2406ed90 msgr2=0x7eff2406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.577+0000 7eff2b045700 1 -- 172.21.15.37:0/4008879161 shutdown_connections 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.578+0000 7eff2b045700 1 -- 172.21.15.37:0/4008879161 wait complete. 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 Processor -- start 2023-10-06T04:17:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 -- start start 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240cd2c0 0x7eff240c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240ce780 0x7eff240c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2415bdd0 con 0x7eff240b2810 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2415b250 con 0x7eff240cd2c0 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2b045700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2415b530 con 0x7eff240ce780 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2a043700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2a043700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45606/0 (socket says 172.21.15.37:45606) 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.579+0000 7eff2a043700 1 -- 172.21.15.37:0/141601198 learned_addr learned my addr 172.21.15.37:0/141601198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a844700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240ce780 0x7eff240c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff29842700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240cd2c0 0x7eff240c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 -- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240ce780 msgr2=0x7eff240c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240ce780 0x7eff240c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 -- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240cd2c0 msgr2=0x7eff240c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240cd2c0 0x7eff240c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 -- 172.21.15.37:0/141601198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009420 con 0x7eff240b2810 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2a043700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff24070da0 tx=0x7eff14019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14012e20 con 0x7eff240b2810 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14027470 con 0x7eff240b2810 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff14009a20 con 0x7eff240b2810 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14027830 con 0x7eff240b2810 2023-10-06T04:17:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.580+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2415baf0 con 0x7eff240b2810 2023-10-06T04:17:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.581+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff240b3720 con 0x7eff240b2810 2023-10-06T04:17:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.582+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff14024070 con 0x7eff240b2810 2023-10-06T04:17:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.582+0000 7eff227fc700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.582+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff14087180 con 0x7eff240b2810 2023-10-06T04:17:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.582+0000 7eff29842700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.583+0000 7eff29842700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 0x7eff100693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff2416d770 tx=0x7eff18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.587+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff14054290 con 0x7eff240b2810 2023-10-06T04:17:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.781+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff2404c3c0 con 0x7eff240b2810 2023-10-06T04:17:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.782+0000 7eff227fc700 1 -- 172.21.15.37:0/141601198 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16818 (secure 0 0 0) 0x7eff140578b0 con 0x7eff240b2810 2023-10-06T04:17:48.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:48.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:17:45.688418+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 msgr2=0x7eff100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 0x7eff100693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff2416d770 tx=0x7eff18009040 comp rx=0 tx=0).stop 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 msgr2=0x7eff240c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff24070da0 tx=0x7eff14019000 comp rx=0 tx=0).stop 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 shutdown_connections 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff240ce780 0x7eff240c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240b2810 0x7eff240c7540 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff10066f30 0x7eff100693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 --2- 172.21.15.37:0/141601198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff240cd2c0 0x7eff240c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 >> 172.21.15.37:0/141601198 conn(0x7eff2406ed90 msgr2=0x7eff240b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 shutdown_connections 2023-10-06T04:17:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.784+0000 7eff2b045700 1 -- 172.21.15.37:0/141601198 wait complete. 2023-10-06T04:17:48.798 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:17:48.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 Processor -- start 2023-10-06T04:17:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 -- start start 2023-10-06T04:17:48.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 0x7f8d6c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d6c0b6200 0x7f8d6c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0ae9f0 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0adb70 con 0x7f8d6c0b6200 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.917+0000 7f8d71c16700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0adde0 con 0x7f8d6c15dc70 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d6c0b6200 0x7f8d6c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d6c0b5e30 0x7f8d6c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60044/0 (socket says 172.21.15.37:60044) 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6b7fe700 1 -- 172.21.15.37:0/4075047630 learned_addr learned my addr 172.21.15.37:0/4075047630 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6affd700 1 --2- 172.21.15.37:0/4075047630 >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 0x7f8d6c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 -- 172.21.15.37:0/4075047630 >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 msgr2=0x7f8d6c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 --2- 172.21.15.37:0/4075047630 >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 0x7f8d6c0ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 -- 172.21.15.37:0/4075047630 >> v1:172.21.15.37:6789/0 conn(0x7f8d6c0b5e30 legacy=0x7f8d6c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 -- 172.21.15.37:0/4075047630 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0ae0c0 con 0x7f8d6c0b6200 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6a7fc700 1 -- 172.21.15.37:0/4075047630 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873375436 0 0) 0x7f8d6c0ae9f0 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6affd700 1 --2- 172.21.15.37:0/4075047630 >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 0x7f8d6c0ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6bfff700 1 --2- 172.21.15.37:0/4075047630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c0ad630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c067e80 tx=0x7f8d64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b34ec6a924adb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6a7fc700 1 -- 172.21.15.37:0/4075047630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400e070 con 0x7f8d6c0b6200 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6a7fc700 1 -- 172.21.15.37:0/4075047630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400bc30 con 0x7f8d6c0b6200 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.918+0000 7f8d6a7fc700 1 -- 172.21.15.37:0/4075047630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64012430 con 0x7f8d6c0b6200 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 -- 172.21.15.37:0/4075047630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b6200 msgr2=0x7f8d6c0ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 --2- 172.21.15.37:0/4075047630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c0ad630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c067e80 tx=0x7f8d64009780 comp rx=0 tx=0).stop 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 -- 172.21.15.37:0/4075047630 shutdown_connections 2023-10-06T04:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 --2- 172.21.15.37:0/4075047630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c0ad630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 --2- 172.21.15.37:0/4075047630 >> v2:172.21.15.83:3300/0 conn(0x7f8d6c15dc70 0x7f8d6c0ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 -- 172.21.15.37:0/4075047630 >> 172.21.15.37:0/4075047630 conn(0x7f8d6c099a10 msgr2=0x7f8d6c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 -- 172.21.15.37:0/4075047630 shutdown_connections 2023-10-06T04:17:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.919+0000 7f8d71c16700 1 -- 172.21.15.37:0/4075047630 wait complete. 2023-10-06T04:17:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.920+0000 7f8d71c16700 1 Processor -- start 2023-10-06T04:17:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.920+0000 7f8d71c16700 1 -- start start 2023-10-06T04:17:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c09da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d6c15dc70 0x7f8d6c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c16e380 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c16d770 con 0x7f8d6c0b6200 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c16da50 con 0x7f8d6c15dc70 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45630/0 (socket says 172.21.15.37:45630) 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 -- 172.21.15.37:0/3968081728 learned_addr learned my addr 172.21.15.37:0/3968081728 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 -- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d6c15dc70 msgr2=0x7f8d6c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d6c15dc70 0x7f8d6c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 -- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6c0b6200 msgr2=0x7f8d6c09da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c09da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 -- 172.21.15.37:0/3968081728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009a20 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d6b7fe700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c7e0 tx=0x7f8d5c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c005b30 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c005c90 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c007300 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c16dd30 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.921+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c159510 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.922+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c0b2f90 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.923+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d5c01b400 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.923+0000 7f8d537fe700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.923+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d5c084210 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.923+0000 7f8d6affd700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.924+0000 7f8d6affd700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d60006fd0 tx=0x7f8d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:48.927+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d5c0513a0 con 0x7f8d6c0b5e30 2023-10-06T04:17:48.991 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-10-06T04:17:48.989+0000 7fd9f54ab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:17:49.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.116+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d6c16e4c0 con 0x7f8d58066f30 2023-10-06T04:17:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.126+0000 7f8d537fe700 1 -- 172.21.15.37:0/3968081728 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311752 (secure 0 0 0) 0x7f8d60007dd0 con 0x7f8d58066f30 2023-10-06T04:17:49.132 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:49.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 msgr2=0x7f8d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d60006fd0 tx=0x7f8d60008040 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 msgr2=0x7f8d6c1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c7e0 tx=0x7f8d5c007df0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 shutdown_connections 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d6c15dc70 0x7f8d6c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d6c0b5e30 0x7f8d6c1503f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 --2- 172.21.15.37:0/3968081728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6c0b6200 0x7f8d6c09da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 >> 172.21.15.37:0/3968081728 conn(0x7f8d6c099a10 msgr2=0x7f8d6c156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 shutdown_connections 2023-10-06T04:17:49.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.129+0000 7f8d71c16700 1 -- 172.21.15.37:0/3968081728 wait complete. 2023-10-06T04:17:49.139 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:49.143 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-10-06T04:17:47.495747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382500,"kb_used_data":4196,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592220,"statfs":{"total":773094113280,"available":770654433280,"internally_reserved":0,"allocated":4296704,"data_stored":2416913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.491449"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711506+0000","last_change":"2023-10-06T04:17:44.707457+0000","last_active":"2023-10-06T04:17:44.711506+0000","last_peered":"2023-10-06T04:17:44.711506+0000","last_clean":"2023-10-06T04:17:44.711506+0000","last_became_active":"2023-10-06T04:17:44.707176+0000","last_became_peered":"2023-10-06T04:17:44.707176+0000","last_unstale":"2023-10-06T04:17:44.711506+0000","last_undegraded":"2023-10-06T04:17:44.711506+0000","last_fullsized":"2023-10-06T04:17:44.711506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:35.435147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708817+0000","last_change":"2023-10-06T04:17:44.701556+0000","last_active":"2023-10-06T04:17:44.708817+0000","last_peered":"2023-10-06T04:17:44.708817+0000","last_clean":"2023-10-06T04:17:44.708817+0000","last_became_active":"2023-10-06T04:17:44.701292+0000","last_became_peered":"2023-10-06T04:17:44.701292+0000","last_unstale":"2023-10-06T04:17:44.708817+0000","last_undegraded":"2023-10-06T04:17:44.708817+0000","last_fullsized":"2023-10-06T04:17:44.708817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:02.427213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704649+0000","last_change":"2023-10-06T04:17:44.700781+0000","last_active":"2023-10-06T04:17:44.704649+0000","last_peered":"2023-10-06T04:17:44.704649+0000","last_clean":"2023-10-06T04:17:44.704649+0000","last_became_active":"2023-10-06T04:17:44.700521+0000","last_became_peered":"2023-10-06T04:17:44.700521+0000","last_unstale":"2023-10-06T04:17:44.704649+0000","last_undegraded":"2023-10-06T04:17:44.704649+0000","last_fullsized":"2023-10-06T04:17:44.704649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711321+0000","last_change":"2023-10-06T04:17:44.707304+0000","last_active":"2023-10-06T04:17:44.711321+0000","last_peered":"2023-10-06T04:17:44.711321+0000","last_clean":"2023-10-06T04:17:44.711321+0000","last_became_active":"2023-10-06T04:17:44.706894+0000","last_became_peered":"2023-10-06T04:17:44.706894+0000","last_unstale":"2023-10-06T04:17:44.711321+0000","last_undegraded":"2023-10-06T04:17:44.711321+0000","last_fullsized":"2023-10-06T04:17:44.711321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:45.110404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711242+0000","last_change":"2023-10-06T04:17:44.706486+0000","last_active":"2023-10-06T04:17:44.711242+0000","last_peered":"2023-10-06T04:17:44.711242+0000","last_clean":"2023-10-06T04:17:44.711242+0000","last_became_active":"2023-10-06T04:17:44.706218+0000","last_became_peered":"2023-10-06T04:17:44.706218+0000","last_unstale":"2023-10-06T04:17:44.711242+0000","last_undegraded":"2023-10-06T04:17:44.711242+0000","last_fullsized":"2023-10-06T04:17:44.711242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:16.229683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708774+0000","last_change":"2023-10-06T04:17:44.703561+0000","last_active":"2023-10-06T04:17:44.708774+0000","last_peered":"2023-10-06T04:17:44.708774+0000","last_clean":"2023-10-06T04:17:44.708774+0000","last_became_active":"2023-10-06T04:17:44.703263+0000","last_became_peered":"2023-10-06T04:17:44.703263+0000","last_unstale":"2023-10-06T04:17:44.708774+0000","last_undegraded":"2023-10-06T04:17:44.708774+0000","last_fullsized":"2023-10-06T04:17:44.708774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710812+0000","last_change":"2023-10-06T04:17:44.702365+0000","last_active":"2023-10-06T04:17:44.710812+0000","last_peered":"2023-10-06T04:17:44.710812+0000","last_clean":"2023-10-06T04:17:44.710812+0000","last_became_active":"2023-10-06T04:17:44.701604+0000","last_became_peered":"2023-10-06T04:17:44.701604+0000","last_unstale":"2023-10-06T04:17:44.710812+0000","last_undegraded":"2023-10-06T04:17:44.710812+0000","last_fullsized":"2023-10-06T04:17:44.710812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:46.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708938+0000","last_change":"2023-10-06T04:17:44.701901+0000","last_active":"2023-10-06T04:17:44.708938+0000","last_peered":"2023-10-06T04:17:44.708938+0000","last_clean":"2023-10-06T04:17:44.708938+0000","last_became_active":"2023-10-06T04:17:44.701637+0000","last_became_peered":"2023-10-06T04:17:44.701637+0000","last_unstale":"2023-10-06T04:17:44.708938+0000","last_undegraded":"2023-10-06T04:17:44.708938+0000","last_fullsized":"2023-10-06T04:17:44.708938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:13.778268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704634+0000","last_change":"2023-10-06T04:17:44.702037+0000","last_active":"2023-10-06T04:17:44.704634+0000","last_peered":"2023-10-06T04:17:44.704634+0000","last_clean":"2023-10-06T04:17:44.704634+0000","last_became_active":"2023-10-06T04:17:44.701783+0000","last_became_peered":"2023-10-06T04:17:44.701783+0000","last_unstale":"2023-10-06T04:17:44.704634+0000","last_undegraded":"2023-10-06T04:17:44.704634+0000","last_fullsized":"2023-10-06T04:17:44.704634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:13.346329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711327+0000","last_change":"2023-10-06T04:17:44.705426+0000","last_active":"2023-10-06T04:17:44.711327+0000","last_peered":"2023-10-06T04:17:44.711327+0000","last_clean":"2023-10-06T04:17:44.711327+0000","last_became_active":"2023-10-06T04:17:44.705113+0000","last_became_peered":"2023-10-06T04:17:44.705113+0000","last_unstale":"2023-10-06T04:17:44.711327+0000","last_undegraded":"2023-10-06T04:17:44.711327+0000","last_fullsized":"2023-10-06T04:17:44.711327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:44.871284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711355+0000","last_change":"2023-10-06T04:17:44.705877+0000","last_active":"2023-10-06T04:17:44.711355+0000","last_peered":"2023-10-06T04:17:44.711355+0000","last_clean":"2023-10-06T04:17:44.711355+0000","last_became_active":"2023-10-06T04:17:44.705451+0000","last_became_peered":"2023-10-06T04:17:44.705451+0000","last_unstale":"2023-10-06T04:17:44.711355+0000","last_undegraded":"2023-10-06T04:17:44.711355+0000","last_fullsized":"2023-10-06T04:17:44.711355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:35.435147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705241+0000","last_change":"2023-10-06T04:17:44.701426+0000","last_active":"2023-10-06T04:17:44.705241+0000","last_peered":"2023-10-06T04:17:44.705241+0000","last_clean":"2023-10-06T04:17:44.705241+0000","last_became_active":"2023-10-06T04:17:44.701148+0000","last_became_peered":"2023-10-06T04:17:44.701148+0000","last_unstale":"2023-10-06T04:17:44.705241+0000","last_undegraded":"2023-10-06T04:17:44.705241+0000","last_fullsized":"2023-10-06T04:17:44.705241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.712230+0000","last_change":"2023-10-06T04:17:44.705597+0000","last_active":"2023-10-06T04:17:44.712230+0000","last_peered":"2023-10-06T04:17:44.712230+0000","last_clean":"2023-10-06T04:17:44.712230+0000","last_became_active":"2023-10-06T04:17:44.705210+0000","last_became_peered":"2023-10-06T04:17:44.705210+0000","last_unstale":"2023-10-06T04:17:44.712230+0000","last_undegraded":"2023-10-06T04:17:44.712230+0000","last_fullsized":"2023-10-06T04:17:44.712230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:13.778268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709130+0000","last_change":"2023-10-06T04:17:44.705819+0000","last_active":"2023-10-06T04:17:44.709130+0000","last_peered":"2023-10-06T04:17:44.709130+0000","last_clean":"2023-10-06T04:17:44.709130+0000","last_became_active":"2023-10-06T04:17:44.705379+0000","last_became_peered":"2023-10-06T04:17:44.705379+0000","last_unstale":"2023-10-06T04:17:44.709130+0000","last_undegraded":"2023-10-06T04:17:44.709130+0000","last_fullsized":"2023-10-06T04:17:44.709130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:32.304707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709969+0000","last_change":"2023-10-06T04:17:44.700767+0000","last_active":"2023-10-06T04:17:44.709969+0000","last_peered":"2023-10-06T04:17:44.709969+0000","last_clean":"2023-10-06T04:17:44.709969+0000","last_became_active":"2023-10-06T04:17:44.700493+0000","last_became_peered":"2023-10-06T04:17:44.700493+0000","last_unstale":"2023-10-06T04:17:44.709969+0000","last_undegraded":"2023-10-06T04:17:44.709969+0000","last_fullsized":"2023-10-06T04:17:44.709969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:25.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714733+0000","last_change":"2023-10-06T04:17:44.713215+0000","last_active":"2023-10-06T04:17:44.714733+0000","last_peered":"2023-10-06T04:17:44.714733+0000","last_clean":"2023-10-06T04:17:44.714733+0000","last_became_active":"2023-10-06T04:17:44.712755+0000","last_became_peered":"2023-10-06T04:17:44.712755+0000","last_unstale":"2023-10-06T04:17:44.714733+0000","last_undegraded":"2023-10-06T04:17:44.714733+0000","last_fullsized":"2023-10-06T04:17:44.714733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714312+0000","last_change":"2023-10-06T04:17:44.712557+0000","last_active":"2023-10-06T04:17:44.714312+0000","last_peered":"2023-10-06T04:17:44.714312+0000","last_clean":"2023-10-06T04:17:44.714312+0000","last_became_active":"2023-10-06T04:17:44.712285+0000","last_became_peered":"2023-10-06T04:17:44.712285+0000","last_unstale":"2023-10-06T04:17:44.714312+0000","last_undegraded":"2023-10-06T04:17:44.714312+0000","last_fullsized":"2023-10-06T04:17:44.714312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:47.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711008+0000","last_change":"2023-10-06T04:17:44.709633+0000","last_active":"2023-10-06T04:17:44.711008+0000","last_peered":"2023-10-06T04:17:44.711008+0000","last_clean":"2023-10-06T04:17:44.711008+0000","last_became_active":"2023-10-06T04:17:44.709364+0000","last_became_peered":"2023-10-06T04:17:44.709364+0000","last_unstale":"2023-10-06T04:17:44.711008+0000","last_undegraded":"2023-10-06T04:17:44.711008+0000","last_fullsized":"2023-10-06T04:17:44.711008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:07.167899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711272+0000","last_change":"2023-10-06T04:17:44.706041+0000","last_active":"2023-10-06T04:17:44.711272+0000","last_peered":"2023-10-06T04:17:44.711272+0000","last_clean":"2023-10-06T04:17:44.711272+0000","last_became_active":"2023-10-06T04:17:44.705776+0000","last_became_peered":"2023-10-06T04:17:44.705776+0000","last_unstale":"2023-10-06T04:17:44.711272+0000","last_undegraded":"2023-10-06T04:17:44.711272+0000","last_fullsized":"2023-10-06T04:17:44.711272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:52.489156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711481+0000","last_change":"2023-10-06T04:17:44.710589+0000","last_active":"2023-10-06T04:17:44.711481+0000","last_peered":"2023-10-06T04:17:44.711481+0000","last_clean":"2023-10-06T04:17:44.711481+0000","last_became_active":"2023-10-06T04:17:44.710308+0000","last_became_peered":"2023-10-06T04:17:44.710308+0000","last_unstale":"2023-10-06T04:17:44.711481+0000","last_undegraded":"2023-10-06T04:17:44.711481+0000","last_fullsized":"2023-10-06T04:17:44.711481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:52.489156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710979+0000","last_change":"2023-10-06T04:17:44.702796+0000","last_active":"2023-10-06T04:17:44.710979+0000","last_peered":"2023-10-06T04:17:44.710979+0000","last_clean":"2023-10-06T04:17:44.710979+0000","last_became_active":"2023-10-06T04:17:44.702500+0000","last_became_peered":"2023-10-06T04:17:44.702500+0000","last_unstale":"2023-10-06T04:17:44.710979+0000","last_undegraded":"2023-10-06T04:17:44.710979+0000","last_fullsized":"2023-10-06T04:17:44.710979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709049+0000","last_change":"2023-10-06T04:17:44.699264+0000","last_active":"2023-10-06T04:17:44.709049+0000","last_peered":"2023-10-06T04:17:44.709049+0000","last_clean":"2023-10-06T04:17:44.709049+0000","last_became_active":"2023-10-06T04:17:44.698972+0000","last_became_peered":"2023-10-06T04:17:44.698972+0000","last_unstale":"2023-10-06T04:17:44.709049+0000","last_undegraded":"2023-10-06T04:17:44.709049+0000","last_fullsized":"2023-10-06T04:17:44.709049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:36.941880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714698+0000","last_change":"2023-10-06T04:17:44.712887+0000","last_active":"2023-10-06T04:17:44.714698+0000","last_peered":"2023-10-06T04:17:44.714698+0000","last_clean":"2023-10-06T04:17:44.714698+0000","last_became_active":"2023-10-06T04:17:44.712572+0000","last_became_peered":"2023-10-06T04:17:44.712572+0000","last_unstale":"2023-10-06T04:17:44.714698+0000","last_undegraded":"2023-10-06T04:17:44.714698+0000","last_fullsized":"2023-10-06T04:17:44.714698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711201+0000","last_change":"2023-10-06T04:17:44.705170+0000","last_active":"2023-10-06T04:17:44.711201+0000","last_peered":"2023-10-06T04:17:44.711201+0000","last_clean":"2023-10-06T04:17:44.711201+0000","last_became_active":"2023-10-06T04:17:44.704982+0000","last_became_peered":"2023-10-06T04:17:44.704982+0000","last_unstale":"2023-10-06T04:17:44.711201+0000","last_undegraded":"2023-10-06T04:17:44.711201+0000","last_fullsized":"2023-10-06T04:17:44.711201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:55.482334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710529+0000","last_change":"2023-10-06T04:17:44.704239+0000","last_active":"2023-10-06T04:17:44.710529+0000","last_peered":"2023-10-06T04:17:44.710529+0000","last_clean":"2023-10-06T04:17:44.710529+0000","last_became_active":"2023-10-06T04:17:44.703954+0000","last_became_peered":"2023-10-06T04:17:44.703954+0000","last_unstale":"2023-10-06T04:17:44.710529+0000","last_undegraded":"2023-10-06T04:17:44.710529+0000","last_fullsized":"2023-10-06T04:17:44.710529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:49.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708710+0000","last_change":"2023-10-06T04:17:44.703241+0000","last_active":"2023-10-06T04:17:44.708710+0000","last_peered":"2023-10-06T04:17:44.708710+0000","last_clean":"2023-10-06T04:17:44.708710+0000","last_became_active":"2023-10-06T04:17:44.702976+0000","last_became_peered":"2023-10-06T04:17:44.702976+0000","last_unstale":"2023-10-06T04:17:44.708710+0000","last_undegraded":"2023-10-06T04:17:44.708710+0000","last_fullsized":"2023-10-06T04:17:44.708710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:04.843737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708717+0000","last_change":"2023-10-06T04:17:44.701233+0000","last_active":"2023-10-06T04:17:44.708717+0000","last_peered":"2023-10-06T04:17:44.708717+0000","last_clean":"2023-10-06T04:17:44.708717+0000","last_became_active":"2023-10-06T04:17:44.700955+0000","last_became_peered":"2023-10-06T04:17:44.700955+0000","last_unstale":"2023-10-06T04:17:44.708717+0000","last_undegraded":"2023-10-06T04:17:44.708717+0000","last_fullsized":"2023-10-06T04:17:44.708717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:36.813762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710784+0000","last_change":"2023-10-06T04:17:44.702263+0000","last_active":"2023-10-06T04:17:44.710784+0000","last_peered":"2023-10-06T04:17:44.710784+0000","last_clean":"2023-10-06T04:17:44.710784+0000","last_became_active":"2023-10-06T04:17:44.701956+0000","last_became_peered":"2023-10-06T04:17:44.701956+0000","last_unstale":"2023-10-06T04:17:44.710784+0000","last_undegraded":"2023-10-06T04:17:44.710784+0000","last_fullsized":"2023-10-06T04:17:44.710784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:09.617757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711001+0000","last_change":"2023-10-06T04:17:44.708265+0000","last_active":"2023-10-06T04:17:44.711001+0000","last_peered":"2023-10-06T04:17:44.711001+0000","last_clean":"2023-10-06T04:17:44.711001+0000","last_became_active":"2023-10-06T04:17:44.707905+0000","last_became_peered":"2023-10-06T04:17:44.707905+0000","last_unstale":"2023-10-06T04:17:44.711001+0000","last_undegraded":"2023-10-06T04:17:44.711001+0000","last_fullsized":"2023-10-06T04:17:44.711001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:57.791379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710201+0000","last_change":"2023-10-06T04:17:44.704030+0000","last_active":"2023-10-06T04:17:44.710201+0000","last_peered":"2023-10-06T04:17:44.710201+0000","last_clean":"2023-10-06T04:17:44.710201+0000","last_became_active":"2023-10-06T04:17:44.703753+0000","last_became_peered":"2023-10-06T04:17:44.703753+0000","last_unstale":"2023-10-06T04:17:44.710201+0000","last_undegraded":"2023-10-06T04:17:44.710201+0000","last_fullsized":"2023-10-06T04:17:44.710201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714737+0000","last_change":"2023-10-06T04:17:44.712972+0000","last_active":"2023-10-06T04:17:44.714737+0000","last_peered":"2023-10-06T04:17:44.714737+0000","last_clean":"2023-10-06T04:17:44.714737+0000","last_became_active":"2023-10-06T04:17:44.712224+0000","last_became_peered":"2023-10-06T04:17:44.712224+0000","last_unstale":"2023-10-06T04:17:44.714737+0000","last_undegraded":"2023-10-06T04:17:44.714737+0000","last_fullsized":"2023-10-06T04:17:44.714737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.707411+0000","last_change":"2023-10-06T04:17:44.698851+0000","last_active":"2023-10-06T04:17:44.707411+0000","last_peered":"2023-10-06T04:17:44.707411+0000","last_clean":"2023-10-06T04:17:44.707411+0000","last_became_active":"2023-10-06T04:17:44.698581+0000","last_became_peered":"2023-10-06T04:17:44.698581+0000","last_unstale":"2023-10-06T04:17:44.707411+0000","last_undegraded":"2023-10-06T04:17:44.707411+0000","last_fullsized":"2023-10-06T04:17:44.707411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714775+0000","last_change":"2023-10-06T04:17:44.713573+0000","last_active":"2023-10-06T04:17:44.714775+0000","last_peered":"2023-10-06T04:17:44.714775+0000","last_clean":"2023-10-06T04:17:44.714775+0000","last_became_active":"2023-10-06T04:17:44.713315+0000","last_became_peered":"2023-10-06T04:17:44.713315+0000","last_unstale":"2023-10-06T04:17:44.714775+0000","last_undegraded":"2023-10-06T04:17:44.714775+0000","last_fullsized":"2023-10-06T04:17:44.714775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027384+0000","last_change":"2023-10-06T04:17:44.031015+0000","last_active":"2023-10-06T04:17:45.027384+0000","last_peered":"2023-10-06T04:17:45.027384+0000","last_clean":"2023-10-06T04:17:45.027384+0000","last_became_active":"2023-10-06T04:17:44.030749+0000","last_became_peered":"2023-10-06T04:17:44.030749+0000","last_unstale":"2023-10-06T04:17:45.027384+0000","last_undegraded":"2023-10-06T04:17:45.027384+0000","last_fullsized":"2023-10-06T04:17:45.027384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:30.931549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708822+0000","last_change":"2023-10-06T04:17:44.704985+0000","last_active":"2023-10-06T04:17:44.708822+0000","last_peered":"2023-10-06T04:17:44.708822+0000","last_clean":"2023-10-06T04:17:44.708822+0000","last_became_active":"2023-10-06T04:17:44.702803+0000","last_became_peered":"2023-10-06T04:17:44.702803+0000","last_unstale":"2023-10-06T04:17:44.708822+0000","last_undegraded":"2023-10-06T04:17:44.708822+0000","last_fullsized":"2023-10-06T04:17:44.708822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:47.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027181+0000","last_change":"2023-10-06T04:17:44.030590+0000","last_active":"2023-10-06T04:17:45.027181+0000","last_peered":"2023-10-06T04:17:45.027181+0000","last_clean":"2023-10-06T04:17:45.027181+0000","last_became_active":"2023-10-06T04:17:44.030335+0000","last_became_peered":"2023-10-06T04:17:44.030335+0000","last_unstale":"2023-10-06T04:17:45.027181+0000","last_undegraded":"2023-10-06T04:17:45.027181+0000","last_fullsized":"2023-10-06T04:17:45.027181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711194+0000","last_change":"2023-10-06T04:17:44.706653+0000","last_active":"2023-10-06T04:17:44.711194+0000","last_peered":"2023-10-06T04:17:44.711194+0000","last_clean":"2023-10-06T04:17:44.711194+0000","last_became_active":"2023-10-06T04:17:44.706236+0000","last_became_peered":"2023-10-06T04:17:44.706236+0000","last_unstale":"2023-10-06T04:17:44.711194+0000","last_undegraded":"2023-10-06T04:17:44.711194+0000","last_fullsized":"2023-10-06T04:17:44.711194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:42.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022889+0000","last_change":"2023-10-06T04:17:44.031593+0000","last_active":"2023-10-06T04:17:45.022889+0000","last_peered":"2023-10-06T04:17:45.022889+0000","last_clean":"2023-10-06T04:17:45.022889+0000","last_became_active":"2023-10-06T04:17:44.030029+0000","last_became_peered":"2023-10-06T04:17:44.030029+0000","last_unstale":"2023-10-06T04:17:45.022889+0000","last_undegraded":"2023-10-06T04:17:45.022889+0000","last_fullsized":"2023-10-06T04:17:45.022889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711493+0000","last_change":"2023-10-06T04:17:44.707350+0000","last_active":"2023-10-06T04:17:44.711493+0000","last_peered":"2023-10-06T04:17:44.711493+0000","last_clean":"2023-10-06T04:17:44.711493+0000","last_became_active":"2023-10-06T04:17:44.707105+0000","last_became_peered":"2023-10-06T04:17:44.707105+0000","last_unstale":"2023-10-06T04:17:44.711493+0000","last_undegraded":"2023-10-06T04:17:44.711493+0000","last_fullsized":"2023-10-06T04:17:44.711493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:09.617757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026727+0000","last_change":"2023-10-06T04:17:44.024869+0000","last_active":"2023-10-06T04:17:45.026727+0000","last_peered":"2023-10-06T04:17:45.026727+0000","last_clean":"2023-10-06T04:17:45.026727+0000","last_became_active":"2023-10-06T04:17:44.022640+0000","last_became_peered":"2023-10-06T04:17:44.022640+0000","last_unstale":"2023-10-06T04:17:45.026727+0000","last_undegraded":"2023-10-06T04:17:45.026727+0000","last_fullsized":"2023-10-06T04:17:45.026727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.407252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.703964+0000","last_change":"2023-10-06T04:17:44.697141+0000","last_active":"2023-10-06T04:17:44.703964+0000","last_peered":"2023-10-06T04:17:44.703964+0000","last_clean":"2023-10-06T04:17:44.703964+0000","last_became_active":"2023-10-06T04:17:44.696884+0000","last_became_peered":"2023-10-06T04:17:44.696884+0000","last_unstale":"2023-10-06T04:17:44.703964+0000","last_undegraded":"2023-10-06T04:17:44.703964+0000","last_fullsized":"2023-10-06T04:17:44.703964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.110081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022162+0000","last_change":"2023-10-06T04:17:44.028707+0000","last_active":"2023-10-06T04:17:45.022162+0000","last_peered":"2023-10-06T04:17:45.022162+0000","last_clean":"2023-10-06T04:17:45.022162+0000","last_became_active":"2023-10-06T04:17:44.028442+0000","last_became_peered":"2023-10-06T04:17:44.028442+0000","last_unstale":"2023-10-06T04:17:45.022162+0000","last_undegraded":"2023-10-06T04:17:45.022162+0000","last_fullsized":"2023-10-06T04:17:45.022162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:44.105159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710943+0000","last_change":"2023-10-06T04:17:44.702948+0000","last_active":"2023-10-06T04:17:44.710943+0000","last_peered":"2023-10-06T04:17:44.710943+0000","last_clean":"2023-10-06T04:17:44.710943+0000","last_became_active":"2023-10-06T04:17:44.702661+0000","last_became_peered":"2023-10-06T04:17:44.702661+0000","last_unstale":"2023-10-06T04:17:44.710943+0000","last_undegraded":"2023-10-06T04:17:44.710943+0000","last_fullsized":"2023-10-06T04:17:44.710943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.023270+0000","last_change":"2023-10-06T04:17:44.031819+0000","last_active":"2023-10-06T04:17:45.023270+0000","last_peered":"2023-10-06T04:17:45.023270+0000","last_clean":"2023-10-06T04:17:45.023270+0000","last_became_active":"2023-10-06T04:17:44.031550+0000","last_became_peered":"2023-10-06T04:17:44.031550+0000","last_unstale":"2023-10-06T04:17:45.023270+0000","last_undegraded":"2023-10-06T04:17:45.023270+0000","last_fullsized":"2023-10-06T04:17:45.023270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:06.162654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709068+0000","last_change":"2023-10-06T04:17:44.704894+0000","last_active":"2023-10-06T04:17:44.709068+0000","last_peered":"2023-10-06T04:17:44.709068+0000","last_clean":"2023-10-06T04:17:44.709068+0000","last_became_active":"2023-10-06T04:17:44.704615+0000","last_became_peered":"2023-10-06T04:17:44.704615+0000","last_unstale":"2023-10-06T04:17:44.709068+0000","last_undegraded":"2023-10-06T04:17:44.709068+0000","last_fullsized":"2023-10-06T04:17:44.709068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:00.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696044+0000","last_change":"2023-10-06T04:17:44.030744+0000","last_active":"2023-10-06T04:17:44.696044+0000","last_peered":"2023-10-06T04:17:44.696044+0000","last_clean":"2023-10-06T04:17:44.696044+0000","last_became_active":"2023-10-06T04:17:44.030499+0000","last_became_peered":"2023-10-06T04:17:44.030499+0000","last_unstale":"2023-10-06T04:17:44.696044+0000","last_undegraded":"2023-10-06T04:17:44.696044+0000","last_fullsized":"2023-10-06T04:17:44.696044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:06.162654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711452+0000","last_change":"2023-10-06T04:17:44.706849+0000","last_active":"2023-10-06T04:17:44.711452+0000","last_peered":"2023-10-06T04:17:44.711452+0000","last_clean":"2023-10-06T04:17:44.711452+0000","last_became_active":"2023-10-06T04:17:44.705705+0000","last_became_peered":"2023-10-06T04:17:44.705705+0000","last_unstale":"2023-10-06T04:17:44.711452+0000","last_undegraded":"2023-10-06T04:17:44.711452+0000","last_fullsized":"2023-10-06T04:17:44.711452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:25.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.692046+0000","last_change":"2023-10-06T04:17:44.026069+0000","last_active":"2023-10-06T04:17:44.692046+0000","last_peered":"2023-10-06T04:17:44.692046+0000","last_clean":"2023-10-06T04:17:44.692046+0000","last_became_active":"2023-10-06T04:17:44.025814+0000","last_became_peered":"2023-10-06T04:17:44.025814+0000","last_unstale":"2023-10-06T04:17:44.692046+0000","last_undegraded":"2023-10-06T04:17:44.692046+0000","last_fullsized":"2023-10-06T04:17:44.692046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:00.868743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711305+0000","last_change":"2023-10-06T04:17:44.707149+0000","last_active":"2023-10-06T04:17:44.711305+0000","last_peered":"2023-10-06T04:17:44.711305+0000","last_clean":"2023-10-06T04:17:44.711305+0000","last_became_active":"2023-10-06T04:17:44.706572+0000","last_became_peered":"2023-10-06T04:17:44.706572+0000","last_unstale":"2023-10-06T04:17:44.711305+0000","last_undegraded":"2023-10-06T04:17:44.711305+0000","last_fullsized":"2023-10-06T04:17:44.711305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:49.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698938+0000","last_change":"2023-10-06T04:17:44.029796+0000","last_active":"2023-10-06T04:17:44.698938+0000","last_peered":"2023-10-06T04:17:44.698938+0000","last_clean":"2023-10-06T04:17:44.698938+0000","last_became_active":"2023-10-06T04:17:44.029320+0000","last_became_peered":"2023-10-06T04:17:44.029320+0000","last_unstale":"2023-10-06T04:17:44.698938+0000","last_undegraded":"2023-10-06T04:17:44.698938+0000","last_fullsized":"2023-10-06T04:17:44.698938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:54.477089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714153+0000","last_change":"2023-10-06T04:17:44.712045+0000","last_active":"2023-10-06T04:17:44.714153+0000","last_peered":"2023-10-06T04:17:44.714153+0000","last_clean":"2023-10-06T04:17:44.714153+0000","last_became_active":"2023-10-06T04:17:44.711699+0000","last_became_peered":"2023-10-06T04:17:44.711699+0000","last_unstale":"2023-10-06T04:17:44.714153+0000","last_undegraded":"2023-10-06T04:17:44.714153+0000","last_fullsized":"2023-10-06T04:17:44.714153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:13.346329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696427+0000","last_change":"2023-10-06T04:17:44.025529+0000","last_active":"2023-10-06T04:17:44.696427+0000","last_peered":"2023-10-06T04:17:44.696427+0000","last_clean":"2023-10-06T04:17:44.696427+0000","last_became_active":"2023-10-06T04:17:44.025254+0000","last_became_peered":"2023-10-06T04:17:44.025254+0000","last_unstale":"2023-10-06T04:17:44.696427+0000","last_undegraded":"2023-10-06T04:17:44.696427+0000","last_fullsized":"2023-10-06T04:17:44.696427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:15.224437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711267+0000","last_change":"2023-10-06T04:17:44.705956+0000","last_active":"2023-10-06T04:17:44.711267+0000","last_peered":"2023-10-06T04:17:44.711267+0000","last_clean":"2023-10-06T04:17:44.711267+0000","last_became_active":"2023-10-06T04:17:44.705686+0000","last_became_peered":"2023-10-06T04:17:44.705686+0000","last_unstale":"2023-10-06T04:17:44.711267+0000","last_undegraded":"2023-10-06T04:17:44.711267+0000","last_fullsized":"2023-10-06T04:17:44.711267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.034550+0000","last_change":"2023-10-06T04:17:44.026968+0000","last_active":"2023-10-06T04:17:45.034550+0000","last_peered":"2023-10-06T04:17:45.034550+0000","last_clean":"2023-10-06T04:17:45.034550+0000","last_became_active":"2023-10-06T04:17:44.026699+0000","last_became_peered":"2023-10-06T04:17:44.026699+0000","last_unstale":"2023-10-06T04:17:45.034550+0000","last_undegraded":"2023-10-06T04:17:45.034550+0000","last_fullsized":"2023-10-06T04:17:45.034550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:54.477089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709067+0000","last_change":"2023-10-06T04:17:44.703504+0000","last_active":"2023-10-06T04:17:44.709067+0000","last_peered":"2023-10-06T04:17:44.709067+0000","last_clean":"2023-10-06T04:17:44.709067+0000","last_became_active":"2023-10-06T04:17:44.703234+0000","last_became_peered":"2023-10-06T04:17:44.703234+0000","last_unstale":"2023-10-06T04:17:44.709067+0000","last_undegraded":"2023-10-06T04:17:44.709067+0000","last_fullsized":"2023-10-06T04:17:44.709067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:22.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.028751+0000","last_change":"2023-10-06T04:17:44.029870+0000","last_active":"2023-10-06T04:17:45.028751+0000","last_peered":"2023-10-06T04:17:45.028751+0000","last_clean":"2023-10-06T04:17:45.028751+0000","last_became_active":"2023-10-06T04:17:44.029586+0000","last_became_peered":"2023-10-06T04:17:44.029586+0000","last_unstale":"2023-10-06T04:17:45.028751+0000","last_undegraded":"2023-10-06T04:17:45.028751+0000","last_fullsized":"2023-10-06T04:17:45.028751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:02.721861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705388+0000","last_change":"2023-10-06T04:17:44.700896+0000","last_active":"2023-10-06T04:17:44.705388+0000","last_peered":"2023-10-06T04:17:44.705388+0000","last_clean":"2023-10-06T04:17:44.705388+0000","last_became_active":"2023-10-06T04:17:44.700632+0000","last_became_peered":"2023-10-06T04:17:44.700632+0000","last_unstale":"2023-10-06T04:17:44.705388+0000","last_undegraded":"2023-10-06T04:17:44.705388+0000","last_fullsized":"2023-10-06T04:17:44.705388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.025503+0000","last_change":"2023-10-06T04:17:44.026573+0000","last_active":"2023-10-06T04:17:45.025503+0000","last_peered":"2023-10-06T04:17:45.025503+0000","last_clean":"2023-10-06T04:17:45.025503+0000","last_became_active":"2023-10-06T04:17:44.026305+0000","last_became_peered":"2023-10-06T04:17:44.026305+0000","last_unstale":"2023-10-06T04:17:45.025503+0000","last_undegraded":"2023-10-06T04:17:45.025503+0000","last_fullsized":"2023-10-06T04:17:45.025503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:54.126500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711394+0000","last_change":"2023-10-06T04:17:44.704499+0000","last_active":"2023-10-06T04:17:44.711394+0000","last_peered":"2023-10-06T04:17:44.711394+0000","last_clean":"2023-10-06T04:17:44.711394+0000","last_became_active":"2023-10-06T04:17:44.704214+0000","last_became_peered":"2023-10-06T04:17:44.704214+0000","last_unstale":"2023-10-06T04:17:44.711394+0000","last_undegraded":"2023-10-06T04:17:44.711394+0000","last_fullsized":"2023-10-06T04:17:44.711394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695818+0000","last_change":"2023-10-06T04:17:44.030711+0000","last_active":"2023-10-06T04:17:44.695818+0000","last_peered":"2023-10-06T04:17:44.695818+0000","last_clean":"2023-10-06T04:17:44.695818+0000","last_became_active":"2023-10-06T04:17:44.030446+0000","last_became_peered":"2023-10-06T04:17:44.030446+0000","last_unstale":"2023-10-06T04:17:44.695818+0000","last_undegraded":"2023-10-06T04:17:44.695818+0000","last_fullsized":"2023-10-06T04:17:44.695818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:51.483911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714194+0000","last_change":"2023-10-06T04:17:44.712164+0000","last_active":"2023-10-06T04:17:44.714194+0000","last_peered":"2023-10-06T04:17:44.714194+0000","last_clean":"2023-10-06T04:17:44.714194+0000","last_became_active":"2023-10-06T04:17:44.711877+0000","last_became_peered":"2023-10-06T04:17:44.711877+0000","last_unstale":"2023-10-06T04:17:44.714194+0000","last_undegraded":"2023-10-06T04:17:44.714194+0000","last_fullsized":"2023-10-06T04:17:44.714194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696840+0000","last_change":"2023-10-06T04:17:44.030216+0000","last_active":"2023-10-06T04:17:44.696840+0000","last_peered":"2023-10-06T04:17:44.696840+0000","last_clean":"2023-10-06T04:17:44.696840+0000","last_became_active":"2023-10-06T04:17:44.029948+0000","last_became_peered":"2023-10-06T04:17:44.029948+0000","last_unstale":"2023-10-06T04:17:44.696840+0000","last_undegraded":"2023-10-06T04:17:44.696840+0000","last_fullsized":"2023-10-06T04:17:44.696840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:35.227861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708727+0000","last_change":"2023-10-06T04:17:44.701234+0000","last_active":"2023-10-06T04:17:44.708727+0000","last_peered":"2023-10-06T04:17:44.708727+0000","last_clean":"2023-10-06T04:17:44.708727+0000","last_became_active":"2023-10-06T04:17:44.700962+0000","last_became_peered":"2023-10-06T04:17:44.700962+0000","last_unstale":"2023-10-06T04:17:44.708727+0000","last_undegraded":"2023-10-06T04:17:44.708727+0000","last_fullsized":"2023-10-06T04:17:44.708727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:44.871284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027562+0000","last_change":"2023-10-06T04:17:44.031777+0000","last_active":"2023-10-06T04:17:45.027562+0000","last_peered":"2023-10-06T04:17:45.027562+0000","last_clean":"2023-10-06T04:17:45.027562+0000","last_became_active":"2023-10-06T04:17:44.031508+0000","last_became_peered":"2023-10-06T04:17:44.031508+0000","last_unstale":"2023-10-06T04:17:45.027562+0000","last_undegraded":"2023-10-06T04:17:45.027562+0000","last_fullsized":"2023-10-06T04:17:45.027562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:53.856112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709053+0000","last_change":"2023-10-06T04:17:44.701441+0000","last_active":"2023-10-06T04:17:44.709053+0000","last_peered":"2023-10-06T04:17:44.709053+0000","last_clean":"2023-10-06T04:17:44.709053+0000","last_became_active":"2023-10-06T04:17:44.701173+0000","last_became_peered":"2023-10-06T04:17:44.701173+0000","last_unstale":"2023-10-06T04:17:44.709053+0000","last_undegraded":"2023-10-06T04:17:44.709053+0000","last_fullsized":"2023-10-06T04:17:44.709053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022117+0000","last_change":"2023-10-06T04:17:44.025959+0000","last_active":"2023-10-06T04:17:45.022117+0000","last_peered":"2023-10-06T04:17:45.022117+0000","last_clean":"2023-10-06T04:17:45.022117+0000","last_became_active":"2023-10-06T04:17:44.025666+0000","last_became_peered":"2023-10-06T04:17:44.025666+0000","last_unstale":"2023-10-06T04:17:45.022117+0000","last_undegraded":"2023-10-06T04:17:45.022117+0000","last_fullsized":"2023-10-06T04:17:45.022117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:54.126500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710862+0000","last_change":"2023-10-06T04:17:44.702567+0000","last_active":"2023-10-06T04:17:44.710862+0000","last_peered":"2023-10-06T04:17:44.710862+0000","last_clean":"2023-10-06T04:17:44.710862+0000","last_became_active":"2023-10-06T04:17:44.702288+0000","last_became_peered":"2023-10-06T04:17:44.702288+0000","last_unstale":"2023-10-06T04:17:44.710862+0000","last_undegraded":"2023-10-06T04:17:44.710862+0000","last_fullsized":"2023-10-06T04:17:44.710862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:35.459386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026747+0000","last_change":"2023-10-06T04:17:44.029919+0000","last_active":"2023-10-06T04:17:45.026747+0000","last_peered":"2023-10-06T04:17:45.026747+0000","last_clean":"2023-10-06T04:17:45.026747+0000","last_became_active":"2023-10-06T04:17:44.029566+0000","last_became_peered":"2023-10-06T04:17:44.029566+0000","last_unstale":"2023-10-06T04:17:45.026747+0000","last_undegraded":"2023-10-06T04:17:45.026747+0000","last_fullsized":"2023-10-06T04:17:45.026747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:12.341083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709112+0000","last_change":"2023-10-06T04:17:44.700940+0000","last_active":"2023-10-06T04:17:44.709112+0000","last_peered":"2023-10-06T04:17:44.709112+0000","last_clean":"2023-10-06T04:17:44.709112+0000","last_became_active":"2023-10-06T04:17:44.700562+0000","last_became_peered":"2023-10-06T04:17:44.700562+0000","last_unstale":"2023-10-06T04:17:44.709112+0000","last_undegraded":"2023-10-06T04:17:44.709112+0000","last_fullsized":"2023-10-06T04:17:44.709112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:10.912082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026494+0000","last_change":"2023-10-06T04:17:44.030685+0000","last_active":"2023-10-06T04:17:45.026494+0000","last_peered":"2023-10-06T04:17:45.026494+0000","last_clean":"2023-10-06T04:17:45.026494+0000","last_became_active":"2023-10-06T04:17:44.030389+0000","last_became_peered":"2023-10-06T04:17:44.030389+0000","last_unstale":"2023-10-06T04:17:45.026494+0000","last_undegraded":"2023-10-06T04:17:45.026494+0000","last_fullsized":"2023-10-06T04:17:45.026494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:29.345731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709030+0000","last_change":"2023-10-06T04:17:44.702640+0000","last_active":"2023-10-06T04:17:44.709030+0000","last_peered":"2023-10-06T04:17:44.709030+0000","last_clean":"2023-10-06T04:17:44.709030+0000","last_became_active":"2023-10-06T04:17:44.702374+0000","last_became_peered":"2023-10-06T04:17:44.702374+0000","last_unstale":"2023-10-06T04:17:44.709030+0000","last_undegraded":"2023-10-06T04:17:44.709030+0000","last_fullsized":"2023-10-06T04:17:44.709030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:55.131746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695820+0000","last_change":"2023-10-06T04:17:44.030183+0000","last_active":"2023-10-06T04:17:44.695820+0000","last_peered":"2023-10-06T04:17:44.695820+0000","last_clean":"2023-10-06T04:17:44.695820+0000","last_became_active":"2023-10-06T04:17:44.029783+0000","last_became_peered":"2023-10-06T04:17:44.029783+0000","last_unstale":"2023-10-06T04:17:44.695820+0000","last_undegraded":"2023-10-06T04:17:44.695820+0000","last_fullsized":"2023-10-06T04:17:44.695820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714708+0000","last_change":"2023-10-06T04:17:44.713151+0000","last_active":"2023-10-06T04:17:44.714708+0000","last_peered":"2023-10-06T04:17:44.714708+0000","last_clean":"2023-10-06T04:17:44.714708+0000","last_became_active":"2023-10-06T04:17:44.711768+0000","last_became_peered":"2023-10-06T04:17:44.711768+0000","last_unstale":"2023-10-06T04:17:44.714708+0000","last_undegraded":"2023-10-06T04:17:44.714708+0000","last_fullsized":"2023-10-06T04:17:44.714708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:24.679261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026154+0000","last_change":"2023-10-06T04:17:44.034467+0000","last_active":"2023-10-06T04:17:45.026154+0000","last_peered":"2023-10-06T04:17:45.026154+0000","last_clean":"2023-10-06T04:17:45.026154+0000","last_became_active":"2023-10-06T04:17:44.034162+0000","last_became_peered":"2023-10-06T04:17:44.034162+0000","last_unstale":"2023-10-06T04:17:45.026154+0000","last_undegraded":"2023-10-06T04:17:45.026154+0000","last_fullsized":"2023-10-06T04:17:45.026154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:14.524017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708535+0000","last_change":"2023-10-06T04:17:44.703465+0000","last_active":"2023-10-06T04:17:44.708535+0000","last_peered":"2023-10-06T04:17:44.708535+0000","last_clean":"2023-10-06T04:17:44.708535+0000","last_became_active":"2023-10-06T04:17:44.703206+0000","last_became_peered":"2023-10-06T04:17:44.703206+0000","last_unstale":"2023-10-06T04:17:44.708535+0000","last_undegraded":"2023-10-06T04:17:44.708535+0000","last_fullsized":"2023-10-06T04:17:44.708535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:01.873988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695471+0000","last_change":"2023-10-06T04:17:44.031080+0000","last_active":"2023-10-06T04:17:44.695471+0000","last_peered":"2023-10-06T04:17:44.695471+0000","last_clean":"2023-10-06T04:17:44.695471+0000","last_became_active":"2023-10-06T04:17:44.030822+0000","last_became_peered":"2023-10-06T04:17:44.030822+0000","last_unstale":"2023-10-06T04:17:44.695471+0000","last_undegraded":"2023-10-06T04:17:44.695471+0000","last_fullsized":"2023-10-06T04:17:44.695471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:23.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710495+0000","last_change":"2023-10-06T04:17:44.701585+0000","last_active":"2023-10-06T04:17:44.710495+0000","last_peered":"2023-10-06T04:17:44.710495+0000","last_clean":"2023-10-06T04:17:44.710495+0000","last_became_active":"2023-10-06T04:17:44.701281+0000","last_became_peered":"2023-10-06T04:17:44.701281+0000","last_unstale":"2023-10-06T04:17:44.710495+0000","last_undegraded":"2023-10-06T04:17:44.710495+0000","last_fullsized":"2023-10-06T04:17:44.710495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:33.818992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702577+0000","last_change":"2023-10-06T04:17:44.032834+0000","last_active":"2023-10-06T04:17:44.702577+0000","last_peered":"2023-10-06T04:17:44.702577+0000","last_clean":"2023-10-06T04:17:44.702577+0000","last_became_active":"2023-10-06T04:17:44.032560+0000","last_became_peered":"2023-10-06T04:17:44.032560+0000","last_unstale":"2023-10-06T04:17:44.702577+0000","last_undegraded":"2023-10-06T04:17:44.702577+0000","last_fullsized":"2023-10-06T04:17:44.702577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:31.550173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711432+0000","last_change":"2023-10-06T04:17:44.706739+0000","last_active":"2023-10-06T04:17:44.711432+0000","last_peered":"2023-10-06T04:17:44.711432+0000","last_clean":"2023-10-06T04:17:44.711432+0000","last_became_active":"2023-10-06T04:17:44.705619+0000","last_became_peered":"2023-10-06T04:17:44.705619+0000","last_unstale":"2023-10-06T04:17:44.711432+0000","last_undegraded":"2023-10-06T04:17:44.711432+0000","last_fullsized":"2023-10-06T04:17:44.711432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:35.459386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.694302+0000","last_change":"2023-10-06T04:17:44.033013+0000","last_active":"2023-10-06T04:17:44.694302+0000","last_peered":"2023-10-06T04:17:44.694302+0000","last_clean":"2023-10-06T04:17:44.694302+0000","last_became_active":"2023-10-06T04:17:44.032636+0000","last_became_peered":"2023-10-06T04:17:44.032636+0000","last_unstale":"2023-10-06T04:17:44.694302+0000","last_undegraded":"2023-10-06T04:17:44.694302+0000","last_fullsized":"2023-10-06T04:17:44.694302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:28.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705411+0000","last_change":"2023-10-06T04:17:44.701521+0000","last_active":"2023-10-06T04:17:44.705411+0000","last_peered":"2023-10-06T04:17:44.705411+0000","last_clean":"2023-10-06T04:17:44.705411+0000","last_became_active":"2023-10-06T04:17:44.701279+0000","last_became_peered":"2023-10-06T04:17:44.701279+0000","last_unstale":"2023-10-06T04:17:44.705411+0000","last_undegraded":"2023-10-06T04:17:44.705411+0000","last_fullsized":"2023-10-06T04:17:44.705411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:10.517021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.690133+0000","last_change":"2023-10-06T04:17:44.027798+0000","last_active":"2023-10-06T04:17:44.690133+0000","last_peered":"2023-10-06T04:17:44.690133+0000","last_clean":"2023-10-06T04:17:44.690133+0000","last_became_active":"2023-10-06T04:17:44.027503+0000","last_became_peered":"2023-10-06T04:17:44.027503+0000","last_unstale":"2023-10-06T04:17:44.690133+0000","last_undegraded":"2023-10-06T04:17:44.690133+0000","last_fullsized":"2023-10-06T04:17:44.690133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695910+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:17:44.695910+0000","last_peered":"2023-10-06T04:17:44.695910+0000","last_clean":"2023-10-06T04:17:44.695910+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:17:44.695910+0000","last_undegraded":"2023-10-06T04:17:44.695910+0000","last_fullsized":"2023-10-06T04:17:44.695910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711531+0000","last_change":"2023-10-06T04:17:44.708278+0000","last_active":"2023-10-06T04:17:44.711531+0000","last_peered":"2023-10-06T04:17:44.711531+0000","last_clean":"2023-10-06T04:17:44.711531+0000","last_became_active":"2023-10-06T04:17:44.708026+0000","last_became_peered":"2023-10-06T04:17:44.708026+0000","last_unstale":"2023-10-06T04:17:44.711531+0000","last_undegraded":"2023-10-06T04:17:44.711531+0000","last_fullsized":"2023-10-06T04:17:44.711531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.690815+0000","last_change":"2023-10-06T04:17:44.031346+0000","last_active":"2023-10-06T04:17:44.690815+0000","last_peered":"2023-10-06T04:17:44.690815+0000","last_clean":"2023-10-06T04:17:44.690815+0000","last_became_active":"2023-10-06T04:17:44.031068+0000","last_became_peered":"2023-10-06T04:17:44.031068+0000","last_unstale":"2023-10-06T04:17:44.690815+0000","last_undegraded":"2023-10-06T04:17:44.690815+0000","last_fullsized":"2023-10-06T04:17:44.690815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:51.483911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.692939+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:17:44.692939+0000","last_peered":"2023-10-06T04:17:44.692939+0000","last_clean":"2023-10-06T04:17:44.692939+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:17:44.692939+0000","last_undegraded":"2023-10-06T04:17:44.692939+0000","last_fullsized":"2023-10-06T04:17:44.692939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714676+0000","last_change":"2023-10-06T04:17:44.712797+0000","last_active":"2023-10-06T04:17:44.714676+0000","last_peered":"2023-10-06T04:17:44.714676+0000","last_clean":"2023-10-06T04:17:44.714676+0000","last_became_active":"2023-10-06T04:17:44.711751+0000","last_became_peered":"2023-10-06T04:17:44.711751+0000","last_unstale":"2023-10-06T04:17:44.714676+0000","last_undegraded":"2023-10-06T04:17:44.714676+0000","last_fullsized":"2023-10-06T04:17:44.714676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:01.873988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693694+0000","last_change":"2023-10-06T04:17:44.029927+0000","last_active":"2023-10-06T04:17:44.693694+0000","last_peered":"2023-10-06T04:17:44.693694+0000","last_clean":"2023-10-06T04:17:44.693694+0000","last_became_active":"2023-10-06T04:17:44.029632+0000","last_became_peered":"2023-10-06T04:17:44.029632+0000","last_unstale":"2023-10-06T04:17:44.693694+0000","last_undegraded":"2023-10-06T04:17:44.693694+0000","last_fullsized":"2023-10-06T04:17:44.693694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:00.045910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693792+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:17:44.693792+0000","last_peered":"2023-10-06T04:17:44.693792+0000","last_clean":"2023-10-06T04:17:44.693792+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:17:44.693792+0000","last_undegraded":"2023-10-06T04:17:44.693792+0000","last_fullsized":"2023-10-06T04:17:44.693792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711479+0000","last_change":"2023-10-06T04:17:44.708272+0000","last_active":"2023-10-06T04:17:44.711479+0000","last_peered":"2023-10-06T04:17:44.711479+0000","last_clean":"2023-10-06T04:17:44.711479+0000","last_became_active":"2023-10-06T04:17:44.707998+0000","last_became_peered":"2023-10-06T04:17:44.707998+0000","last_unstale":"2023-10-06T04:17:44.711479+0000","last_undegraded":"2023-10-06T04:17:44.711479+0000","last_fullsized":"2023-10-06T04:17:44.711479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:02.427213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704508+0000","last_change":"2023-10-06T04:17:44.032930+0000","last_active":"2023-10-06T04:17:44.704508+0000","last_peered":"2023-10-06T04:17:44.704508+0000","last_clean":"2023-10-06T04:17:44.704508+0000","last_became_active":"2023-10-06T04:17:44.032678+0000","last_became_peered":"2023-10-06T04:17:44.032678+0000","last_unstale":"2023-10-06T04:17:44.704508+0000","last_undegraded":"2023-10-06T04:17:44.704508+0000","last_fullsized":"2023-10-06T04:17:44.704508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:35.808517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693334+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:17:44.693334+0000","last_peered":"2023-10-06T04:17:44.693334+0000","last_clean":"2023-10-06T04:17:44.693334+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:17:44.693334+0000","last_undegraded":"2023-10-06T04:17:44.693334+0000","last_fullsized":"2023-10-06T04:17:44.693334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702156+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:17:44.702156+0000","last_peered":"2023-10-06T04:17:44.702156+0000","last_clean":"2023-10-06T04:17:44.702156+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:17:44.702156+0000","last_undegraded":"2023-10-06T04:17:44.702156+0000","last_fullsized":"2023-10-06T04:17:44.702156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709259+0000","last_change":"2023-10-06T04:17:44.703033+0000","last_active":"2023-10-06T04:17:44.709259+0000","last_peered":"2023-10-06T04:17:44.709259+0000","last_clean":"2023-10-06T04:17:44.709259+0000","last_became_active":"2023-10-06T04:17:44.702726+0000","last_became_peered":"2023-10-06T04:17:44.702726+0000","last_unstale":"2023-10-06T04:17:44.709259+0000","last_undegraded":"2023-10-06T04:17:44.709259+0000","last_fullsized":"2023-10-06T04:17:44.709259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.023400+0000","last_change":"2023-10-06T04:17:44.027241+0000","last_active":"2023-10-06T04:17:45.023400+0000","last_peered":"2023-10-06T04:17:45.023400+0000","last_clean":"2023-10-06T04:17:45.023400+0000","last_became_active":"2023-10-06T04:17:44.026691+0000","last_became_peered":"2023-10-06T04:17:44.026691+0000","last_unstale":"2023-10-06T04:17:45.023400+0000","last_undegraded":"2023-10-06T04:17:45.023400+0000","last_fullsized":"2023-10-06T04:17:45.023400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702060+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:17:44.702060+0000","last_peered":"2023-10-06T04:17:44.702060+0000","last_clean":"2023-10-06T04:17:44.702060+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:17:44.702060+0000","last_undegraded":"2023-10-06T04:17:44.702060+0000","last_fullsized":"2023-10-06T04:17:44.702060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.706272+0000","last_change":"2023-10-06T04:17:44.699433+0000","last_active":"2023-10-06T04:17:44.706272+0000","last_peered":"2023-10-06T04:17:44.706272+0000","last_clean":"2023-10-06T04:17:44.706272+0000","last_became_active":"2023-10-06T04:17:44.699207+0000","last_became_peered":"2023-10-06T04:17:44.699207+0000","last_unstale":"2023-10-06T04:17:44.706272+0000","last_undegraded":"2023-10-06T04:17:44.706272+0000","last_fullsized":"2023-10-06T04:17:44.706272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:24.679261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.697498+0000","last_change":"2023-10-06T04:17:44.034627+0000","last_active":"2023-10-06T04:17:44.697498+0000","last_peered":"2023-10-06T04:17:44.697498+0000","last_clean":"2023-10-06T04:17:44.697498+0000","last_became_active":"2023-10-06T04:17:44.034353+0000","last_became_peered":"2023-10-06T04:17:44.034353+0000","last_unstale":"2023-10-06T04:17:44.697498+0000","last_undegraded":"2023-10-06T04:17:44.697498+0000","last_fullsized":"2023-10-06T04:17:44.697498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:20.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704954+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:17:44.704954+0000","last_peered":"2023-10-06T04:17:44.704954+0000","last_clean":"2023-10-06T04:17:44.704954+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:17:44.704954+0000","last_undegraded":"2023-10-06T04:17:44.704954+0000","last_fullsized":"2023-10-06T04:17:44.704954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709112+0000","last_change":"2023-10-06T04:17:44.705637+0000","last_active":"2023-10-06T04:17:44.709112+0000","last_peered":"2023-10-06T04:17:44.709112+0000","last_clean":"2023-10-06T04:17:44.709112+0000","last_became_active":"2023-10-06T04:17:44.705088+0000","last_became_peered":"2023-10-06T04:17:44.705088+0000","last_unstale":"2023-10-06T04:17:44.709112+0000","last_undegraded":"2023-10-06T04:17:44.709112+0000","last_fullsized":"2023-10-06T04:17:44.709112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:46.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693786+0000","last_change":"2023-10-06T04:17:44.022775+0000","last_active":"2023-10-06T04:17:44.693786+0000","last_peered":"2023-10-06T04:17:44.693786+0000","last_clean":"2023-10-06T04:17:44.693786+0000","last_became_active":"2023-10-06T04:17:44.022534+0000","last_became_peered":"2023-10-06T04:17:44.022534+0000","last_unstale":"2023-10-06T04:17:44.693786+0000","last_undegraded":"2023-10-06T04:17:44.693786+0000","last_fullsized":"2023-10-06T04:17:44.693786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:46.467077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698472+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:17:44.698472+0000","last_peered":"2023-10-06T04:17:44.698472+0000","last_clean":"2023-10-06T04:17:44.698472+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:17:44.698472+0000","last_undegraded":"2023-10-06T04:17:44.698472+0000","last_fullsized":"2023-10-06T04:17:44.698472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714738+0000","last_change":"2023-10-06T04:17:44.713362+0000","last_active":"2023-10-06T04:17:44.714738+0000","last_peered":"2023-10-06T04:17:44.714738+0000","last_clean":"2023-10-06T04:17:44.714738+0000","last_became_active":"2023-10-06T04:17:44.712969+0000","last_became_peered":"2023-10-06T04:17:44.712969+0000","last_unstale":"2023-10-06T04:17:44.714738+0000","last_undegraded":"2023-10-06T04:17:44.714738+0000","last_fullsized":"2023-10-06T04:17:44.714738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698014+0000","last_change":"2023-10-06T04:17:44.022573+0000","last_active":"2023-10-06T04:17:44.698014+0000","last_peered":"2023-10-06T04:17:44.698014+0000","last_clean":"2023-10-06T04:17:44.698014+0000","last_became_active":"2023-10-06T04:17:44.022324+0000","last_became_peered":"2023-10-06T04:17:44.022324+0000","last_unstale":"2023-10-06T04:17:44.698014+0000","last_undegraded":"2023-10-06T04:17:44.698014+0000","last_fullsized":"2023-10-06T04:17:44.698014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:44.105159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696440+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:17:44.696440+0000","last_peered":"2023-10-06T04:17:44.696440+0000","last_clean":"2023-10-06T04:17:44.696440+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:17:44.696440+0000","last_undegraded":"2023-10-06T04:17:44.696440+0000","last_fullsized":"2023-10-06T04:17:44.696440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":748410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":11.148999999999999,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":11.288,"5min":11.288,"15min":11.288},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":11.271000000000001,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.186999999999999,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":11.33,"5min":11.33,"15min":11.33},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.2530000000000001,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":150349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":156526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.374},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.441},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":746838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":1.9359999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":1.9690000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":2.6659999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":2.2839999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.319},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":2.0009999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":2.0449999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":149865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.27600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":158006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.371},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.314},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":150371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":156548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.432}]},{"osd":3,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:49.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:17:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.300+0000 7f22586c1700 1 Processor -- start 2023-10-06T04:17:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.300+0000 7f22586c1700 1 -- start start 2023-10-06T04:17:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f22586c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22500b3430 0x7f2250159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f22586c1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f22586c1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500ab500 con 0x7f2250159950 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f22586c1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500b6550 con 0x7f22500b3430 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f22586c1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500b1cc0 con 0x7f225015a260 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f2255c5c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22500b3430 0x7f2250159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f2255c5c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22500b3430 0x7f2250159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45634/0 (socket says 172.21.15.37:45634) 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.301+0000 7f2255c5c700 1 -- 172.21.15.37:0/278211277 learned_addr learned my addr 172.21.15.37:0/278211277 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2256c5e700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2255c5c700 1 -- 172.21.15.37:0/278211277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 msgr2=0x7f22500b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2255c5c700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2255c5c700 1 -- 172.21.15.37:0/278211277 >> v1:172.21.15.83:6789/0 conn(0x7f2250159950 legacy=0x7f22500b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2255c5c700 1 -- 172.21.15.37:0/278211277 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500b10b0 con 0x7f22500b3430 2023-10-06T04:17:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f2255c5c700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22500b3430 0x7f2250159d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f22440099b0 tx=0x7f2244009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5747737f4ac3017b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f225545b700 1 -- 172.21.15.37:0/278211277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400b820 con 0x7f22500b3430 2023-10-06T04:17:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f225545b700 1 -- 172.21.15.37:0/278211277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400b980 con 0x7f22500b3430 2023-10-06T04:17:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.302+0000 7f225545b700 1 -- 172.21.15.37:0/278211277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400bd20 con 0x7f22500b3430 2023-10-06T04:17:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 -- 172.21.15.37:0/278211277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22500b3430 msgr2=0x7f2250159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22500b3430 0x7f2250159d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f22440099b0 tx=0x7f2244009250 comp rx=0 tx=0).stop 2023-10-06T04:17:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 -- 172.21.15.37:0/278211277 shutdown_connections 2023-10-06T04:17:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 --2- 172.21.15.37:0/278211277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22500b3430 0x7f2250159d20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 -- 172.21.15.37:0/278211277 >> 172.21.15.37:0/278211277 conn(0x7f2250099a10 msgr2=0x7f225006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 -- 172.21.15.37:0/278211277 shutdown_connections 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.303+0000 7f22586c1700 1 -- 172.21.15.37:0/278211277 wait complete. 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 Processor -- start 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 -- start start 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22500b3430 0x7f22501510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500ce2d0 con 0x7f2250159950 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250151600 con 0x7f22500b3430 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.304+0000 7f22586c1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500cde40 con 0x7f225015a260 2023-10-06T04:17:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45650/0 (socket says 172.21.15.37:45650) 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 -- 172.21.15.37:0/3807504510 learned_addr learned my addr 172.21.15.37:0/3807504510 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2256c5e700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f225645d700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22500b3430 0x7f22501510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 -- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 msgr2=0x7f22500b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 -- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22500b3430 msgr2=0x7f22501510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22500b3430 0x7f22501510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 -- 172.21.15.37:0/3807504510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440094f0 con 0x7f2250159950 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f2255c5c700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2250088fa0 tx=0x7f2244016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011cf0 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2244020070 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500cd230 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224401b6a0 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.305+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500cd7f0 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.306+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250063410 con 0x7f2250159950 2023-10-06T04:17:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.307+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2244022030 con 0x7f2250159950 2023-10-06T04:17:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.307+0000 7f224e7fc700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.307+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2244086660 con 0x7f2250159950 2023-10-06T04:17:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.307+0000 7f225645d700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.308+0000 7f225645d700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 0x7f223c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2248003870 tx=0x7f2248009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.311+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2244053770 con 0x7f2250159950 2023-10-06T04:17:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.499+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2250063410 con 0x7f223c066f30 2023-10-06T04:17:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.508+0000 7f224e7fc700 1 -- 172.21.15.37:0/3807504510 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311752 (secure 0 0 0) 0x7f2250063410 con 0x7f223c066f30 2023-10-06T04:17:49.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.511+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 msgr2=0x7f223c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.511+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 0x7f223c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2248003870 tx=0x7f2248009040 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.511+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 msgr2=0x7f225009d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.511+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2250088fa0 tx=0x7f2244016000 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 shutdown_connections 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f225015a260 0x7f22500b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f223c066f30 0x7f223c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22500b3430 0x7f22501510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 --2- 172.21.15.37:0/3807504510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2250159950 0x7f225009d8e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 >> 172.21.15.37:0/3807504510 conn(0x7f2250099a10 msgr2=0x7f225006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 shutdown_connections 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.512+0000 7f22586c1700 1 -- 172.21.15.37:0/3807504510 wait complete. 2023-10-06T04:17:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:17:49.525 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T04:17:49.496330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382500,"kb_used_data":4196,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592220,"statfs":{"total":773094113280,"available":770654433280,"internally_reserved":0,"allocated":4296704,"data_stored":2416913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001360"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711506+0000","last_change":"2023-10-06T04:17:44.707457+0000","last_active":"2023-10-06T04:17:44.711506+0000","last_peered":"2023-10-06T04:17:44.711506+0000","last_clean":"2023-10-06T04:17:44.711506+0000","last_became_active":"2023-10-06T04:17:44.707176+0000","last_became_peered":"2023-10-06T04:17:44.707176+0000","last_unstale":"2023-10-06T04:17:44.711506+0000","last_undegraded":"2023-10-06T04:17:44.711506+0000","last_fullsized":"2023-10-06T04:17:44.711506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:35.435147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708817+0000","last_change":"2023-10-06T04:17:44.701556+0000","last_active":"2023-10-06T04:17:44.708817+0000","last_peered":"2023-10-06T04:17:44.708817+0000","last_clean":"2023-10-06T04:17:44.708817+0000","last_became_active":"2023-10-06T04:17:44.701292+0000","last_became_peered":"2023-10-06T04:17:44.701292+0000","last_unstale":"2023-10-06T04:17:44.708817+0000","last_undegraded":"2023-10-06T04:17:44.708817+0000","last_fullsized":"2023-10-06T04:17:44.708817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:02.427213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704649+0000","last_change":"2023-10-06T04:17:44.700781+0000","last_active":"2023-10-06T04:17:44.704649+0000","last_peered":"2023-10-06T04:17:44.704649+0000","last_clean":"2023-10-06T04:17:44.704649+0000","last_became_active":"2023-10-06T04:17:44.700521+0000","last_became_peered":"2023-10-06T04:17:44.700521+0000","last_unstale":"2023-10-06T04:17:44.704649+0000","last_undegraded":"2023-10-06T04:17:44.704649+0000","last_fullsized":"2023-10-06T04:17:44.704649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711321+0000","last_change":"2023-10-06T04:17:44.707304+0000","last_active":"2023-10-06T04:17:44.711321+0000","last_peered":"2023-10-06T04:17:44.711321+0000","last_clean":"2023-10-06T04:17:44.711321+0000","last_became_active":"2023-10-06T04:17:44.706894+0000","last_became_peered":"2023-10-06T04:17:44.706894+0000","last_unstale":"2023-10-06T04:17:44.711321+0000","last_undegraded":"2023-10-06T04:17:44.711321+0000","last_fullsized":"2023-10-06T04:17:44.711321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:45.110404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711242+0000","last_change":"2023-10-06T04:17:44.706486+0000","last_active":"2023-10-06T04:17:44.711242+0000","last_peered":"2023-10-06T04:17:44.711242+0000","last_clean":"2023-10-06T04:17:44.711242+0000","last_became_active":"2023-10-06T04:17:44.706218+0000","last_became_peered":"2023-10-06T04:17:44.706218+0000","last_unstale":"2023-10-06T04:17:44.711242+0000","last_undegraded":"2023-10-06T04:17:44.711242+0000","last_fullsized":"2023-10-06T04:17:44.711242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:16.229683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708774+0000","last_change":"2023-10-06T04:17:44.703561+0000","last_active":"2023-10-06T04:17:44.708774+0000","last_peered":"2023-10-06T04:17:44.708774+0000","last_clean":"2023-10-06T04:17:44.708774+0000","last_became_active":"2023-10-06T04:17:44.703263+0000","last_became_peered":"2023-10-06T04:17:44.703263+0000","last_unstale":"2023-10-06T04:17:44.708774+0000","last_undegraded":"2023-10-06T04:17:44.708774+0000","last_fullsized":"2023-10-06T04:17:44.708774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710812+0000","last_change":"2023-10-06T04:17:44.702365+0000","last_active":"2023-10-06T04:17:44.710812+0000","last_peered":"2023-10-06T04:17:44.710812+0000","last_clean":"2023-10-06T04:17:44.710812+0000","last_became_active":"2023-10-06T04:17:44.701604+0000","last_became_peered":"2023-10-06T04:17:44.701604+0000","last_unstale":"2023-10-06T04:17:44.710812+0000","last_undegraded":"2023-10-06T04:17:44.710812+0000","last_fullsized":"2023-10-06T04:17:44.710812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:46.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708938+0000","last_change":"2023-10-06T04:17:44.701901+0000","last_active":"2023-10-06T04:17:44.708938+0000","last_peered":"2023-10-06T04:17:44.708938+0000","last_clean":"2023-10-06T04:17:44.708938+0000","last_became_active":"2023-10-06T04:17:44.701637+0000","last_became_peered":"2023-10-06T04:17:44.701637+0000","last_unstale":"2023-10-06T04:17:44.708938+0000","last_undegraded":"2023-10-06T04:17:44.708938+0000","last_fullsized":"2023-10-06T04:17:44.708938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:13.778268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704634+0000","last_change":"2023-10-06T04:17:44.702037+0000","last_active":"2023-10-06T04:17:44.704634+0000","last_peered":"2023-10-06T04:17:44.704634+0000","last_clean":"2023-10-06T04:17:44.704634+0000","last_became_active":"2023-10-06T04:17:44.701783+0000","last_became_peered":"2023-10-06T04:17:44.701783+0000","last_unstale":"2023-10-06T04:17:44.704634+0000","last_undegraded":"2023-10-06T04:17:44.704634+0000","last_fullsized":"2023-10-06T04:17:44.704634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:13.346329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711327+0000","last_change":"2023-10-06T04:17:44.705426+0000","last_active":"2023-10-06T04:17:44.711327+0000","last_peered":"2023-10-06T04:17:44.711327+0000","last_clean":"2023-10-06T04:17:44.711327+0000","last_became_active":"2023-10-06T04:17:44.705113+0000","last_became_peered":"2023-10-06T04:17:44.705113+0000","last_unstale":"2023-10-06T04:17:44.711327+0000","last_undegraded":"2023-10-06T04:17:44.711327+0000","last_fullsized":"2023-10-06T04:17:44.711327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:44.871284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711355+0000","last_change":"2023-10-06T04:17:44.705877+0000","last_active":"2023-10-06T04:17:44.711355+0000","last_peered":"2023-10-06T04:17:44.711355+0000","last_clean":"2023-10-06T04:17:44.711355+0000","last_became_active":"2023-10-06T04:17:44.705451+0000","last_became_peered":"2023-10-06T04:17:44.705451+0000","last_unstale":"2023-10-06T04:17:44.711355+0000","last_undegraded":"2023-10-06T04:17:44.711355+0000","last_fullsized":"2023-10-06T04:17:44.711355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:35.435147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705241+0000","last_change":"2023-10-06T04:17:44.701426+0000","last_active":"2023-10-06T04:17:44.705241+0000","last_peered":"2023-10-06T04:17:44.705241+0000","last_clean":"2023-10-06T04:17:44.705241+0000","last_became_active":"2023-10-06T04:17:44.701148+0000","last_became_peered":"2023-10-06T04:17:44.701148+0000","last_unstale":"2023-10-06T04:17:44.705241+0000","last_undegraded":"2023-10-06T04:17:44.705241+0000","last_fullsized":"2023-10-06T04:17:44.705241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.712230+0000","last_change":"2023-10-06T04:17:44.705597+0000","last_active":"2023-10-06T04:17:44.712230+0000","last_peered":"2023-10-06T04:17:44.712230+0000","last_clean":"2023-10-06T04:17:44.712230+0000","last_became_active":"2023-10-06T04:17:44.705210+0000","last_became_peered":"2023-10-06T04:17:44.705210+0000","last_unstale":"2023-10-06T04:17:44.712230+0000","last_undegraded":"2023-10-06T04:17:44.712230+0000","last_fullsized":"2023-10-06T04:17:44.712230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:13.778268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709130+0000","last_change":"2023-10-06T04:17:44.705819+0000","last_active":"2023-10-06T04:17:44.709130+0000","last_peered":"2023-10-06T04:17:44.709130+0000","last_clean":"2023-10-06T04:17:44.709130+0000","last_became_active":"2023-10-06T04:17:44.705379+0000","last_became_peered":"2023-10-06T04:17:44.705379+0000","last_unstale":"2023-10-06T04:17:44.709130+0000","last_undegraded":"2023-10-06T04:17:44.709130+0000","last_fullsized":"2023-10-06T04:17:44.709130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:32.304707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709969+0000","last_change":"2023-10-06T04:17:44.700767+0000","last_active":"2023-10-06T04:17:44.709969+0000","last_peered":"2023-10-06T04:17:44.709969+0000","last_clean":"2023-10-06T04:17:44.709969+0000","last_became_active":"2023-10-06T04:17:44.700493+0000","last_became_peered":"2023-10-06T04:17:44.700493+0000","last_unstale":"2023-10-06T04:17:44.709969+0000","last_undegraded":"2023-10-06T04:17:44.709969+0000","last_fullsized":"2023-10-06T04:17:44.709969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:25.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714733+0000","last_change":"2023-10-06T04:17:44.713215+0000","last_active":"2023-10-06T04:17:44.714733+0000","last_peered":"2023-10-06T04:17:44.714733+0000","last_clean":"2023-10-06T04:17:44.714733+0000","last_became_active":"2023-10-06T04:17:44.712755+0000","last_became_peered":"2023-10-06T04:17:44.712755+0000","last_unstale":"2023-10-06T04:17:44.714733+0000","last_undegraded":"2023-10-06T04:17:44.714733+0000","last_fullsized":"2023-10-06T04:17:44.714733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714312+0000","last_change":"2023-10-06T04:17:44.712557+0000","last_active":"2023-10-06T04:17:44.714312+0000","last_peered":"2023-10-06T04:17:44.714312+0000","last_clean":"2023-10-06T04:17:44.714312+0000","last_became_active":"2023-10-06T04:17:44.712285+0000","last_became_peered":"2023-10-06T04:17:44.712285+0000","last_unstale":"2023-10-06T04:17:44.714312+0000","last_undegraded":"2023-10-06T04:17:44.714312+0000","last_fullsized":"2023-10-06T04:17:44.714312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:47.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711008+0000","last_change":"2023-10-06T04:17:44.709633+0000","last_active":"2023-10-06T04:17:44.711008+0000","last_peered":"2023-10-06T04:17:44.711008+0000","last_clean":"2023-10-06T04:17:44.711008+0000","last_became_active":"2023-10-06T04:17:44.709364+0000","last_became_peered":"2023-10-06T04:17:44.709364+0000","last_unstale":"2023-10-06T04:17:44.711008+0000","last_undegraded":"2023-10-06T04:17:44.711008+0000","last_fullsized":"2023-10-06T04:17:44.711008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:07.167899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711272+0000","last_change":"2023-10-06T04:17:44.706041+0000","last_active":"2023-10-06T04:17:44.711272+0000","last_peered":"2023-10-06T04:17:44.711272+0000","last_clean":"2023-10-06T04:17:44.711272+0000","last_became_active":"2023-10-06T04:17:44.705776+0000","last_became_peered":"2023-10-06T04:17:44.705776+0000","last_unstale":"2023-10-06T04:17:44.711272+0000","last_undegraded":"2023-10-06T04:17:44.711272+0000","last_fullsized":"2023-10-06T04:17:44.711272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:52.489156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711481+0000","last_change":"2023-10-06T04:17:44.710589+0000","last_active":"2023-10-06T04:17:44.711481+0000","last_peered":"2023-10-06T04:17:44.711481+0000","last_clean":"2023-10-06T04:17:44.711481+0000","last_became_active":"2023-10-06T04:17:44.710308+0000","last_became_peered":"2023-10-06T04:17:44.710308+0000","last_unstale":"2023-10-06T04:17:44.711481+0000","last_undegraded":"2023-10-06T04:17:44.711481+0000","last_fullsized":"2023-10-06T04:17:44.711481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:52.489156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710979+0000","last_change":"2023-10-06T04:17:44.702796+0000","last_active":"2023-10-06T04:17:44.710979+0000","last_peered":"2023-10-06T04:17:44.710979+0000","last_clean":"2023-10-06T04:17:44.710979+0000","last_became_active":"2023-10-06T04:17:44.702500+0000","last_became_peered":"2023-10-06T04:17:44.702500+0000","last_unstale":"2023-10-06T04:17:44.710979+0000","last_undegraded":"2023-10-06T04:17:44.710979+0000","last_fullsized":"2023-10-06T04:17:44.710979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709049+0000","last_change":"2023-10-06T04:17:44.699264+0000","last_active":"2023-10-06T04:17:44.709049+0000","last_peered":"2023-10-06T04:17:44.709049+0000","last_clean":"2023-10-06T04:17:44.709049+0000","last_became_active":"2023-10-06T04:17:44.698972+0000","last_became_peered":"2023-10-06T04:17:44.698972+0000","last_unstale":"2023-10-06T04:17:44.709049+0000","last_undegraded":"2023-10-06T04:17:44.709049+0000","last_fullsized":"2023-10-06T04:17:44.709049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:36.941880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714698+0000","last_change":"2023-10-06T04:17:44.712887+0000","last_active":"2023-10-06T04:17:44.714698+0000","last_peered":"2023-10-06T04:17:44.714698+0000","last_clean":"2023-10-06T04:17:44.714698+0000","last_became_active":"2023-10-06T04:17:44.712572+0000","last_became_peered":"2023-10-06T04:17:44.712572+0000","last_unstale":"2023-10-06T04:17:44.714698+0000","last_undegraded":"2023-10-06T04:17:44.714698+0000","last_fullsized":"2023-10-06T04:17:44.714698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711201+0000","last_change":"2023-10-06T04:17:44.705170+0000","last_active":"2023-10-06T04:17:44.711201+0000","last_peered":"2023-10-06T04:17:44.711201+0000","last_clean":"2023-10-06T04:17:44.711201+0000","last_became_active":"2023-10-06T04:17:44.704982+0000","last_became_peered":"2023-10-06T04:17:44.704982+0000","last_unstale":"2023-10-06T04:17:44.711201+0000","last_undegraded":"2023-10-06T04:17:44.711201+0000","last_fullsized":"2023-10-06T04:17:44.711201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:55.482334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710529+0000","last_change":"2023-10-06T04:17:44.704239+0000","last_active":"2023-10-06T04:17:44.710529+0000","last_peered":"2023-10-06T04:17:44.710529+0000","last_clean":"2023-10-06T04:17:44.710529+0000","last_became_active":"2023-10-06T04:17:44.703954+0000","last_became_peered":"2023-10-06T04:17:44.703954+0000","last_unstale":"2023-10-06T04:17:44.710529+0000","last_undegraded":"2023-10-06T04:17:44.710529+0000","last_fullsized":"2023-10-06T04:17:44.710529+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:49.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708710+0000","last_change":"2023-10-06T04:17:44.703241+0000","last_active":"2023-10-06T04:17:44.708710+0000","last_peered":"2023-10-06T04:17:44.708710+0000","last_clean":"2023-10-06T04:17:44.708710+0000","last_became_active":"2023-10-06T04:17:44.702976+0000","last_became_peered":"2023-10-06T04:17:44.702976+0000","last_unstale":"2023-10-06T04:17:44.708710+0000","last_undegraded":"2023-10-06T04:17:44.708710+0000","last_fullsized":"2023-10-06T04:17:44.708710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:23:04.843737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708717+0000","last_change":"2023-10-06T04:17:44.701233+0000","last_active":"2023-10-06T04:17:44.708717+0000","last_peered":"2023-10-06T04:17:44.708717+0000","last_clean":"2023-10-06T04:17:44.708717+0000","last_became_active":"2023-10-06T04:17:44.700955+0000","last_became_peered":"2023-10-06T04:17:44.700955+0000","last_unstale":"2023-10-06T04:17:44.708717+0000","last_undegraded":"2023-10-06T04:17:44.708717+0000","last_fullsized":"2023-10-06T04:17:44.708717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:36.813762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710784+0000","last_change":"2023-10-06T04:17:44.702263+0000","last_active":"2023-10-06T04:17:44.710784+0000","last_peered":"2023-10-06T04:17:44.710784+0000","last_clean":"2023-10-06T04:17:44.710784+0000","last_became_active":"2023-10-06T04:17:44.701956+0000","last_became_peered":"2023-10-06T04:17:44.701956+0000","last_unstale":"2023-10-06T04:17:44.710784+0000","last_undegraded":"2023-10-06T04:17:44.710784+0000","last_fullsized":"2023-10-06T04:17:44.710784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:09.617757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711001+0000","last_change":"2023-10-06T04:17:44.708265+0000","last_active":"2023-10-06T04:17:44.711001+0000","last_peered":"2023-10-06T04:17:44.711001+0000","last_clean":"2023-10-06T04:17:44.711001+0000","last_became_active":"2023-10-06T04:17:44.707905+0000","last_became_peered":"2023-10-06T04:17:44.707905+0000","last_unstale":"2023-10-06T04:17:44.711001+0000","last_undegraded":"2023-10-06T04:17:44.711001+0000","last_fullsized":"2023-10-06T04:17:44.711001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:57.791379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710201+0000","last_change":"2023-10-06T04:17:44.704030+0000","last_active":"2023-10-06T04:17:44.710201+0000","last_peered":"2023-10-06T04:17:44.710201+0000","last_clean":"2023-10-06T04:17:44.710201+0000","last_became_active":"2023-10-06T04:17:44.703753+0000","last_became_peered":"2023-10-06T04:17:44.703753+0000","last_unstale":"2023-10-06T04:17:44.710201+0000","last_undegraded":"2023-10-06T04:17:44.710201+0000","last_fullsized":"2023-10-06T04:17:44.710201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:54.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714737+0000","last_change":"2023-10-06T04:17:44.712972+0000","last_active":"2023-10-06T04:17:44.714737+0000","last_peered":"2023-10-06T04:17:44.714737+0000","last_clean":"2023-10-06T04:17:44.714737+0000","last_became_active":"2023-10-06T04:17:44.712224+0000","last_became_peered":"2023-10-06T04:17:44.712224+0000","last_unstale":"2023-10-06T04:17:44.714737+0000","last_undegraded":"2023-10-06T04:17:44.714737+0000","last_fullsized":"2023-10-06T04:17:44.714737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.707411+0000","last_change":"2023-10-06T04:17:44.698851+0000","last_active":"2023-10-06T04:17:44.707411+0000","last_peered":"2023-10-06T04:17:44.707411+0000","last_clean":"2023-10-06T04:17:44.707411+0000","last_became_active":"2023-10-06T04:17:44.698581+0000","last_became_peered":"2023-10-06T04:17:44.698581+0000","last_unstale":"2023-10-06T04:17:44.707411+0000","last_undegraded":"2023-10-06T04:17:44.707411+0000","last_fullsized":"2023-10-06T04:17:44.707411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714775+0000","last_change":"2023-10-06T04:17:44.713573+0000","last_active":"2023-10-06T04:17:44.714775+0000","last_peered":"2023-10-06T04:17:44.714775+0000","last_clean":"2023-10-06T04:17:44.714775+0000","last_became_active":"2023-10-06T04:17:44.713315+0000","last_became_peered":"2023-10-06T04:17:44.713315+0000","last_unstale":"2023-10-06T04:17:44.714775+0000","last_undegraded":"2023-10-06T04:17:44.714775+0000","last_fullsized":"2023-10-06T04:17:44.714775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027384+0000","last_change":"2023-10-06T04:17:44.031015+0000","last_active":"2023-10-06T04:17:45.027384+0000","last_peered":"2023-10-06T04:17:45.027384+0000","last_clean":"2023-10-06T04:17:45.027384+0000","last_became_active":"2023-10-06T04:17:44.030749+0000","last_became_peered":"2023-10-06T04:17:44.030749+0000","last_unstale":"2023-10-06T04:17:45.027384+0000","last_undegraded":"2023-10-06T04:17:45.027384+0000","last_fullsized":"2023-10-06T04:17:45.027384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:30.931549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708822+0000","last_change":"2023-10-06T04:17:44.704985+0000","last_active":"2023-10-06T04:17:44.708822+0000","last_peered":"2023-10-06T04:17:44.708822+0000","last_clean":"2023-10-06T04:17:44.708822+0000","last_became_active":"2023-10-06T04:17:44.702803+0000","last_became_peered":"2023-10-06T04:17:44.702803+0000","last_unstale":"2023-10-06T04:17:44.708822+0000","last_undegraded":"2023-10-06T04:17:44.708822+0000","last_fullsized":"2023-10-06T04:17:44.708822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:47.843254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027181+0000","last_change":"2023-10-06T04:17:44.030590+0000","last_active":"2023-10-06T04:17:45.027181+0000","last_peered":"2023-10-06T04:17:45.027181+0000","last_clean":"2023-10-06T04:17:45.027181+0000","last_became_active":"2023-10-06T04:17:44.030335+0000","last_became_peered":"2023-10-06T04:17:44.030335+0000","last_unstale":"2023-10-06T04:17:45.027181+0000","last_undegraded":"2023-10-06T04:17:45.027181+0000","last_fullsized":"2023-10-06T04:17:45.027181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711194+0000","last_change":"2023-10-06T04:17:44.706653+0000","last_active":"2023-10-06T04:17:44.711194+0000","last_peered":"2023-10-06T04:17:44.711194+0000","last_clean":"2023-10-06T04:17:44.711194+0000","last_became_active":"2023-10-06T04:17:44.706236+0000","last_became_peered":"2023-10-06T04:17:44.706236+0000","last_unstale":"2023-10-06T04:17:44.711194+0000","last_undegraded":"2023-10-06T04:17:44.711194+0000","last_fullsized":"2023-10-06T04:17:44.711194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:42.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022889+0000","last_change":"2023-10-06T04:17:44.031593+0000","last_active":"2023-10-06T04:17:45.022889+0000","last_peered":"2023-10-06T04:17:45.022889+0000","last_clean":"2023-10-06T04:17:45.022889+0000","last_became_active":"2023-10-06T04:17:44.030029+0000","last_became_peered":"2023-10-06T04:17:44.030029+0000","last_unstale":"2023-10-06T04:17:45.022889+0000","last_undegraded":"2023-10-06T04:17:45.022889+0000","last_fullsized":"2023-10-06T04:17:45.022889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:56.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711493+0000","last_change":"2023-10-06T04:17:44.707350+0000","last_active":"2023-10-06T04:17:44.711493+0000","last_peered":"2023-10-06T04:17:44.711493+0000","last_clean":"2023-10-06T04:17:44.711493+0000","last_became_active":"2023-10-06T04:17:44.707105+0000","last_became_peered":"2023-10-06T04:17:44.707105+0000","last_unstale":"2023-10-06T04:17:44.711493+0000","last_undegraded":"2023-10-06T04:17:44.711493+0000","last_fullsized":"2023-10-06T04:17:44.711493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:09.617757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026727+0000","last_change":"2023-10-06T04:17:44.024869+0000","last_active":"2023-10-06T04:17:45.026727+0000","last_peered":"2023-10-06T04:17:45.026727+0000","last_clean":"2023-10-06T04:17:45.026727+0000","last_became_active":"2023-10-06T04:17:44.022640+0000","last_became_peered":"2023-10-06T04:17:44.022640+0000","last_unstale":"2023-10-06T04:17:45.026727+0000","last_undegraded":"2023-10-06T04:17:45.026727+0000","last_fullsized":"2023-10-06T04:17:45.026727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:17.407252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.703964+0000","last_change":"2023-10-06T04:17:44.697141+0000","last_active":"2023-10-06T04:17:44.703964+0000","last_peered":"2023-10-06T04:17:44.703964+0000","last_clean":"2023-10-06T04:17:44.703964+0000","last_became_active":"2023-10-06T04:17:44.696884+0000","last_became_peered":"2023-10-06T04:17:44.696884+0000","last_unstale":"2023-10-06T04:17:44.703964+0000","last_undegraded":"2023-10-06T04:17:44.703964+0000","last_fullsized":"2023-10-06T04:17:44.703964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.110081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022162+0000","last_change":"2023-10-06T04:17:44.028707+0000","last_active":"2023-10-06T04:17:45.022162+0000","last_peered":"2023-10-06T04:17:45.022162+0000","last_clean":"2023-10-06T04:17:45.022162+0000","last_became_active":"2023-10-06T04:17:44.028442+0000","last_became_peered":"2023-10-06T04:17:44.028442+0000","last_unstale":"2023-10-06T04:17:45.022162+0000","last_undegraded":"2023-10-06T04:17:45.022162+0000","last_fullsized":"2023-10-06T04:17:45.022162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:44.105159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710943+0000","last_change":"2023-10-06T04:17:44.702948+0000","last_active":"2023-10-06T04:17:44.710943+0000","last_peered":"2023-10-06T04:17:44.710943+0000","last_clean":"2023-10-06T04:17:44.710943+0000","last_became_active":"2023-10-06T04:17:44.702661+0000","last_became_peered":"2023-10-06T04:17:44.702661+0000","last_unstale":"2023-10-06T04:17:44.710943+0000","last_undegraded":"2023-10-06T04:17:44.710943+0000","last_fullsized":"2023-10-06T04:17:44.710943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:47.472322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.023270+0000","last_change":"2023-10-06T04:17:44.031819+0000","last_active":"2023-10-06T04:17:45.023270+0000","last_peered":"2023-10-06T04:17:45.023270+0000","last_clean":"2023-10-06T04:17:45.023270+0000","last_became_active":"2023-10-06T04:17:44.031550+0000","last_became_peered":"2023-10-06T04:17:44.031550+0000","last_unstale":"2023-10-06T04:17:45.023270+0000","last_undegraded":"2023-10-06T04:17:45.023270+0000","last_fullsized":"2023-10-06T04:17:45.023270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:06.162654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709068+0000","last_change":"2023-10-06T04:17:44.704894+0000","last_active":"2023-10-06T04:17:44.709068+0000","last_peered":"2023-10-06T04:17:44.709068+0000","last_clean":"2023-10-06T04:17:44.709068+0000","last_became_active":"2023-10-06T04:17:44.704615+0000","last_became_peered":"2023-10-06T04:17:44.704615+0000","last_unstale":"2023-10-06T04:17:44.709068+0000","last_undegraded":"2023-10-06T04:17:44.709068+0000","last_fullsized":"2023-10-06T04:17:44.709068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:00.079291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696044+0000","last_change":"2023-10-06T04:17:44.030744+0000","last_active":"2023-10-06T04:17:44.696044+0000","last_peered":"2023-10-06T04:17:44.696044+0000","last_clean":"2023-10-06T04:17:44.696044+0000","last_became_active":"2023-10-06T04:17:44.030499+0000","last_became_peered":"2023-10-06T04:17:44.030499+0000","last_unstale":"2023-10-06T04:17:44.696044+0000","last_undegraded":"2023-10-06T04:17:44.696044+0000","last_fullsized":"2023-10-06T04:17:44.696044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:06.162654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711452+0000","last_change":"2023-10-06T04:17:44.706849+0000","last_active":"2023-10-06T04:17:44.711452+0000","last_peered":"2023-10-06T04:17:44.711452+0000","last_clean":"2023-10-06T04:17:44.711452+0000","last_became_active":"2023-10-06T04:17:44.705705+0000","last_became_peered":"2023-10-06T04:17:44.705705+0000","last_unstale":"2023-10-06T04:17:44.711452+0000","last_undegraded":"2023-10-06T04:17:44.711452+0000","last_fullsized":"2023-10-06T04:17:44.711452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:25.227156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.692046+0000","last_change":"2023-10-06T04:17:44.026069+0000","last_active":"2023-10-06T04:17:44.692046+0000","last_peered":"2023-10-06T04:17:44.692046+0000","last_clean":"2023-10-06T04:17:44.692046+0000","last_became_active":"2023-10-06T04:17:44.025814+0000","last_became_peered":"2023-10-06T04:17:44.025814+0000","last_unstale":"2023-10-06T04:17:44.692046+0000","last_undegraded":"2023-10-06T04:17:44.692046+0000","last_fullsized":"2023-10-06T04:17:44.692046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:00.868743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711305+0000","last_change":"2023-10-06T04:17:44.707149+0000","last_active":"2023-10-06T04:17:44.711305+0000","last_peered":"2023-10-06T04:17:44.711305+0000","last_clean":"2023-10-06T04:17:44.711305+0000","last_became_active":"2023-10-06T04:17:44.706572+0000","last_became_peered":"2023-10-06T04:17:44.706572+0000","last_unstale":"2023-10-06T04:17:44.711305+0000","last_undegraded":"2023-10-06T04:17:44.711305+0000","last_fullsized":"2023-10-06T04:17:44.711305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:49.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698938+0000","last_change":"2023-10-06T04:17:44.029796+0000","last_active":"2023-10-06T04:17:44.698938+0000","last_peered":"2023-10-06T04:17:44.698938+0000","last_clean":"2023-10-06T04:17:44.698938+0000","last_became_active":"2023-10-06T04:17:44.029320+0000","last_became_peered":"2023-10-06T04:17:44.029320+0000","last_unstale":"2023-10-06T04:17:44.698938+0000","last_undegraded":"2023-10-06T04:17:44.698938+0000","last_fullsized":"2023-10-06T04:17:44.698938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:54.477089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714153+0000","last_change":"2023-10-06T04:17:44.712045+0000","last_active":"2023-10-06T04:17:44.714153+0000","last_peered":"2023-10-06T04:17:44.714153+0000","last_clean":"2023-10-06T04:17:44.714153+0000","last_became_active":"2023-10-06T04:17:44.711699+0000","last_became_peered":"2023-10-06T04:17:44.711699+0000","last_unstale":"2023-10-06T04:17:44.714153+0000","last_undegraded":"2023-10-06T04:17:44.714153+0000","last_fullsized":"2023-10-06T04:17:44.714153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:13.346329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696427+0000","last_change":"2023-10-06T04:17:44.025529+0000","last_active":"2023-10-06T04:17:44.696427+0000","last_peered":"2023-10-06T04:17:44.696427+0000","last_clean":"2023-10-06T04:17:44.696427+0000","last_became_active":"2023-10-06T04:17:44.025254+0000","last_became_peered":"2023-10-06T04:17:44.025254+0000","last_unstale":"2023-10-06T04:17:44.696427+0000","last_undegraded":"2023-10-06T04:17:44.696427+0000","last_fullsized":"2023-10-06T04:17:44.696427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:15.224437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711267+0000","last_change":"2023-10-06T04:17:44.705956+0000","last_active":"2023-10-06T04:17:44.711267+0000","last_peered":"2023-10-06T04:17:44.711267+0000","last_clean":"2023-10-06T04:17:44.711267+0000","last_became_active":"2023-10-06T04:17:44.705686+0000","last_became_peered":"2023-10-06T04:17:44.705686+0000","last_unstale":"2023-10-06T04:17:44.711267+0000","last_undegraded":"2023-10-06T04:17:44.711267+0000","last_fullsized":"2023-10-06T04:17:44.711267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.034550+0000","last_change":"2023-10-06T04:17:44.026968+0000","last_active":"2023-10-06T04:17:45.034550+0000","last_peered":"2023-10-06T04:17:45.034550+0000","last_clean":"2023-10-06T04:17:45.034550+0000","last_became_active":"2023-10-06T04:17:44.026699+0000","last_became_peered":"2023-10-06T04:17:44.026699+0000","last_unstale":"2023-10-06T04:17:45.034550+0000","last_undegraded":"2023-10-06T04:17:45.034550+0000","last_fullsized":"2023-10-06T04:17:45.034550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:44:54.477089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709067+0000","last_change":"2023-10-06T04:17:44.703504+0000","last_active":"2023-10-06T04:17:44.709067+0000","last_peered":"2023-10-06T04:17:44.709067+0000","last_clean":"2023-10-06T04:17:44.709067+0000","last_became_active":"2023-10-06T04:17:44.703234+0000","last_became_peered":"2023-10-06T04:17:44.703234+0000","last_unstale":"2023-10-06T04:17:44.709067+0000","last_undegraded":"2023-10-06T04:17:44.709067+0000","last_fullsized":"2023-10-06T04:17:44.709067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:22.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.028751+0000","last_change":"2023-10-06T04:17:44.029870+0000","last_active":"2023-10-06T04:17:45.028751+0000","last_peered":"2023-10-06T04:17:45.028751+0000","last_clean":"2023-10-06T04:17:45.028751+0000","last_became_active":"2023-10-06T04:17:44.029586+0000","last_became_peered":"2023-10-06T04:17:44.029586+0000","last_unstale":"2023-10-06T04:17:45.028751+0000","last_undegraded":"2023-10-06T04:17:45.028751+0000","last_fullsized":"2023-10-06T04:17:45.028751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:02.721861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705388+0000","last_change":"2023-10-06T04:17:44.700896+0000","last_active":"2023-10-06T04:17:44.705388+0000","last_peered":"2023-10-06T04:17:44.705388+0000","last_clean":"2023-10-06T04:17:44.705388+0000","last_became_active":"2023-10-06T04:17:44.700632+0000","last_became_peered":"2023-10-06T04:17:44.700632+0000","last_unstale":"2023-10-06T04:17:44.705388+0000","last_undegraded":"2023-10-06T04:17:44.705388+0000","last_fullsized":"2023-10-06T04:17:44.705388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:01.656699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.025503+0000","last_change":"2023-10-06T04:17:44.026573+0000","last_active":"2023-10-06T04:17:45.025503+0000","last_peered":"2023-10-06T04:17:45.025503+0000","last_clean":"2023-10-06T04:17:45.025503+0000","last_became_active":"2023-10-06T04:17:44.026305+0000","last_became_peered":"2023-10-06T04:17:44.026305+0000","last_unstale":"2023-10-06T04:17:45.025503+0000","last_undegraded":"2023-10-06T04:17:45.025503+0000","last_fullsized":"2023-10-06T04:17:45.025503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:54.126500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711394+0000","last_change":"2023-10-06T04:17:44.704499+0000","last_active":"2023-10-06T04:17:44.711394+0000","last_peered":"2023-10-06T04:17:44.711394+0000","last_clean":"2023-10-06T04:17:44.711394+0000","last_became_active":"2023-10-06T04:17:44.704214+0000","last_became_peered":"2023-10-06T04:17:44.704214+0000","last_unstale":"2023-10-06T04:17:44.711394+0000","last_undegraded":"2023-10-06T04:17:44.711394+0000","last_fullsized":"2023-10-06T04:17:44.711394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695818+0000","last_change":"2023-10-06T04:17:44.030711+0000","last_active":"2023-10-06T04:17:44.695818+0000","last_peered":"2023-10-06T04:17:44.695818+0000","last_clean":"2023-10-06T04:17:44.695818+0000","last_became_active":"2023-10-06T04:17:44.030446+0000","last_became_peered":"2023-10-06T04:17:44.030446+0000","last_unstale":"2023-10-06T04:17:44.695818+0000","last_undegraded":"2023-10-06T04:17:44.695818+0000","last_fullsized":"2023-10-06T04:17:44.695818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:51.483911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714194+0000","last_change":"2023-10-06T04:17:44.712164+0000","last_active":"2023-10-06T04:17:44.714194+0000","last_peered":"2023-10-06T04:17:44.714194+0000","last_clean":"2023-10-06T04:17:44.714194+0000","last_became_active":"2023-10-06T04:17:44.711877+0000","last_became_peered":"2023-10-06T04:17:44.711877+0000","last_unstale":"2023-10-06T04:17:44.714194+0000","last_undegraded":"2023-10-06T04:17:44.714194+0000","last_fullsized":"2023-10-06T04:17:44.714194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:21.117529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696840+0000","last_change":"2023-10-06T04:17:44.030216+0000","last_active":"2023-10-06T04:17:44.696840+0000","last_peered":"2023-10-06T04:17:44.696840+0000","last_clean":"2023-10-06T04:17:44.696840+0000","last_became_active":"2023-10-06T04:17:44.029948+0000","last_became_peered":"2023-10-06T04:17:44.029948+0000","last_unstale":"2023-10-06T04:17:44.696840+0000","last_undegraded":"2023-10-06T04:17:44.696840+0000","last_fullsized":"2023-10-06T04:17:44.696840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:35.227861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708727+0000","last_change":"2023-10-06T04:17:44.701234+0000","last_active":"2023-10-06T04:17:44.708727+0000","last_peered":"2023-10-06T04:17:44.708727+0000","last_clean":"2023-10-06T04:17:44.708727+0000","last_became_active":"2023-10-06T04:17:44.700962+0000","last_became_peered":"2023-10-06T04:17:44.700962+0000","last_unstale":"2023-10-06T04:17:44.708727+0000","last_undegraded":"2023-10-06T04:17:44.708727+0000","last_fullsized":"2023-10-06T04:17:44.708727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:44.871284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.027562+0000","last_change":"2023-10-06T04:17:44.031777+0000","last_active":"2023-10-06T04:17:45.027562+0000","last_peered":"2023-10-06T04:17:45.027562+0000","last_clean":"2023-10-06T04:17:45.027562+0000","last_became_active":"2023-10-06T04:17:44.031508+0000","last_became_peered":"2023-10-06T04:17:44.031508+0000","last_unstale":"2023-10-06T04:17:45.027562+0000","last_undegraded":"2023-10-06T04:17:45.027562+0000","last_fullsized":"2023-10-06T04:17:45.027562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:53.856112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709053+0000","last_change":"2023-10-06T04:17:44.701441+0000","last_active":"2023-10-06T04:17:44.709053+0000","last_peered":"2023-10-06T04:17:44.709053+0000","last_clean":"2023-10-06T04:17:44.709053+0000","last_became_active":"2023-10-06T04:17:44.701173+0000","last_became_peered":"2023-10-06T04:17:44.701173+0000","last_unstale":"2023-10-06T04:17:44.709053+0000","last_undegraded":"2023-10-06T04:17:44.709053+0000","last_fullsized":"2023-10-06T04:17:44.709053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:30.479989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.022117+0000","last_change":"2023-10-06T04:17:44.025959+0000","last_active":"2023-10-06T04:17:45.022117+0000","last_peered":"2023-10-06T04:17:45.022117+0000","last_clean":"2023-10-06T04:17:45.022117+0000","last_became_active":"2023-10-06T04:17:44.025666+0000","last_became_peered":"2023-10-06T04:17:44.025666+0000","last_unstale":"2023-10-06T04:17:45.022117+0000","last_undegraded":"2023-10-06T04:17:45.022117+0000","last_fullsized":"2023-10-06T04:17:45.022117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:54.126500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710862+0000","last_change":"2023-10-06T04:17:44.702567+0000","last_active":"2023-10-06T04:17:44.710862+0000","last_peered":"2023-10-06T04:17:44.710862+0000","last_clean":"2023-10-06T04:17:44.710862+0000","last_became_active":"2023-10-06T04:17:44.702288+0000","last_became_peered":"2023-10-06T04:17:44.702288+0000","last_unstale":"2023-10-06T04:17:44.710862+0000","last_undegraded":"2023-10-06T04:17:44.710862+0000","last_fullsized":"2023-10-06T04:17:44.710862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:35.459386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026747+0000","last_change":"2023-10-06T04:17:44.029919+0000","last_active":"2023-10-06T04:17:45.026747+0000","last_peered":"2023-10-06T04:17:45.026747+0000","last_clean":"2023-10-06T04:17:45.026747+0000","last_became_active":"2023-10-06T04:17:44.029566+0000","last_became_peered":"2023-10-06T04:17:44.029566+0000","last_unstale":"2023-10-06T04:17:45.026747+0000","last_undegraded":"2023-10-06T04:17:45.026747+0000","last_fullsized":"2023-10-06T04:17:45.026747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:12.341083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709112+0000","last_change":"2023-10-06T04:17:44.700940+0000","last_active":"2023-10-06T04:17:44.709112+0000","last_peered":"2023-10-06T04:17:44.709112+0000","last_clean":"2023-10-06T04:17:44.709112+0000","last_became_active":"2023-10-06T04:17:44.700562+0000","last_became_peered":"2023-10-06T04:17:44.700562+0000","last_unstale":"2023-10-06T04:17:44.709112+0000","last_undegraded":"2023-10-06T04:17:44.709112+0000","last_fullsized":"2023-10-06T04:17:44.709112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:10.912082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026494+0000","last_change":"2023-10-06T04:17:44.030685+0000","last_active":"2023-10-06T04:17:45.026494+0000","last_peered":"2023-10-06T04:17:45.026494+0000","last_clean":"2023-10-06T04:17:45.026494+0000","last_became_active":"2023-10-06T04:17:44.030389+0000","last_became_peered":"2023-10-06T04:17:44.030389+0000","last_unstale":"2023-10-06T04:17:45.026494+0000","last_undegraded":"2023-10-06T04:17:45.026494+0000","last_fullsized":"2023-10-06T04:17:45.026494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:29.345731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709030+0000","last_change":"2023-10-06T04:17:44.702640+0000","last_active":"2023-10-06T04:17:44.709030+0000","last_peered":"2023-10-06T04:17:44.709030+0000","last_clean":"2023-10-06T04:17:44.709030+0000","last_became_active":"2023-10-06T04:17:44.702374+0000","last_became_peered":"2023-10-06T04:17:44.702374+0000","last_unstale":"2023-10-06T04:17:44.709030+0000","last_undegraded":"2023-10-06T04:17:44.709030+0000","last_fullsized":"2023-10-06T04:17:44.709030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:55.131746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695820+0000","last_change":"2023-10-06T04:17:44.030183+0000","last_active":"2023-10-06T04:17:44.695820+0000","last_peered":"2023-10-06T04:17:44.695820+0000","last_clean":"2023-10-06T04:17:44.695820+0000","last_became_active":"2023-10-06T04:17:44.029783+0000","last_became_peered":"2023-10-06T04:17:44.029783+0000","last_unstale":"2023-10-06T04:17:44.695820+0000","last_undegraded":"2023-10-06T04:17:44.695820+0000","last_fullsized":"2023-10-06T04:17:44.695820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714708+0000","last_change":"2023-10-06T04:17:44.713151+0000","last_active":"2023-10-06T04:17:44.714708+0000","last_peered":"2023-10-06T04:17:44.714708+0000","last_clean":"2023-10-06T04:17:44.714708+0000","last_became_active":"2023-10-06T04:17:44.711768+0000","last_became_peered":"2023-10-06T04:17:44.711768+0000","last_unstale":"2023-10-06T04:17:44.714708+0000","last_undegraded":"2023-10-06T04:17:44.714708+0000","last_fullsized":"2023-10-06T04:17:44.714708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:24.679261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.026154+0000","last_change":"2023-10-06T04:17:44.034467+0000","last_active":"2023-10-06T04:17:45.026154+0000","last_peered":"2023-10-06T04:17:45.026154+0000","last_clean":"2023-10-06T04:17:45.026154+0000","last_became_active":"2023-10-06T04:17:44.034162+0000","last_became_peered":"2023-10-06T04:17:44.034162+0000","last_unstale":"2023-10-06T04:17:45.026154+0000","last_undegraded":"2023-10-06T04:17:45.026154+0000","last_fullsized":"2023-10-06T04:17:45.026154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:14.524017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.708535+0000","last_change":"2023-10-06T04:17:44.703465+0000","last_active":"2023-10-06T04:17:44.708535+0000","last_peered":"2023-10-06T04:17:44.708535+0000","last_clean":"2023-10-06T04:17:44.708535+0000","last_became_active":"2023-10-06T04:17:44.703206+0000","last_became_peered":"2023-10-06T04:17:44.703206+0000","last_unstale":"2023-10-06T04:17:44.708535+0000","last_undegraded":"2023-10-06T04:17:44.708535+0000","last_fullsized":"2023-10-06T04:17:44.708535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:01.873988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695471+0000","last_change":"2023-10-06T04:17:44.031080+0000","last_active":"2023-10-06T04:17:44.695471+0000","last_peered":"2023-10-06T04:17:44.695471+0000","last_clean":"2023-10-06T04:17:44.695471+0000","last_became_active":"2023-10-06T04:17:44.030822+0000","last_became_peered":"2023-10-06T04:17:44.030822+0000","last_unstale":"2023-10-06T04:17:44.695471+0000","last_undegraded":"2023-10-06T04:17:44.695471+0000","last_fullsized":"2023-10-06T04:17:44.695471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:23.354913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.710495+0000","last_change":"2023-10-06T04:17:44.701585+0000","last_active":"2023-10-06T04:17:44.710495+0000","last_peered":"2023-10-06T04:17:44.710495+0000","last_clean":"2023-10-06T04:17:44.710495+0000","last_became_active":"2023-10-06T04:17:44.701281+0000","last_became_peered":"2023-10-06T04:17:44.701281+0000","last_unstale":"2023-10-06T04:17:44.710495+0000","last_undegraded":"2023-10-06T04:17:44.710495+0000","last_fullsized":"2023-10-06T04:17:44.710495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:33.818992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702577+0000","last_change":"2023-10-06T04:17:44.032834+0000","last_active":"2023-10-06T04:17:44.702577+0000","last_peered":"2023-10-06T04:17:44.702577+0000","last_clean":"2023-10-06T04:17:44.702577+0000","last_became_active":"2023-10-06T04:17:44.032560+0000","last_became_peered":"2023-10-06T04:17:44.032560+0000","last_unstale":"2023-10-06T04:17:44.702577+0000","last_undegraded":"2023-10-06T04:17:44.702577+0000","last_fullsized":"2023-10-06T04:17:44.702577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:31.550173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711432+0000","last_change":"2023-10-06T04:17:44.706739+0000","last_active":"2023-10-06T04:17:44.711432+0000","last_peered":"2023-10-06T04:17:44.711432+0000","last_clean":"2023-10-06T04:17:44.711432+0000","last_became_active":"2023-10-06T04:17:44.705619+0000","last_became_peered":"2023-10-06T04:17:44.705619+0000","last_unstale":"2023-10-06T04:17:44.711432+0000","last_undegraded":"2023-10-06T04:17:44.711432+0000","last_fullsized":"2023-10-06T04:17:44.711432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:02:35.459386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.694302+0000","last_change":"2023-10-06T04:17:44.033013+0000","last_active":"2023-10-06T04:17:44.694302+0000","last_peered":"2023-10-06T04:17:44.694302+0000","last_clean":"2023-10-06T04:17:44.694302+0000","last_became_active":"2023-10-06T04:17:44.032636+0000","last_became_peered":"2023-10-06T04:17:44.032636+0000","last_unstale":"2023-10-06T04:17:44.694302+0000","last_undegraded":"2023-10-06T04:17:44.694302+0000","last_fullsized":"2023-10-06T04:17:44.694302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:28.597376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.705411+0000","last_change":"2023-10-06T04:17:44.701521+0000","last_active":"2023-10-06T04:17:44.705411+0000","last_peered":"2023-10-06T04:17:44.705411+0000","last_clean":"2023-10-06T04:17:44.705411+0000","last_became_active":"2023-10-06T04:17:44.701279+0000","last_became_peered":"2023-10-06T04:17:44.701279+0000","last_unstale":"2023-10-06T04:17:44.705411+0000","last_undegraded":"2023-10-06T04:17:44.705411+0000","last_fullsized":"2023-10-06T04:17:44.705411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:10.517021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.690133+0000","last_change":"2023-10-06T04:17:44.027798+0000","last_active":"2023-10-06T04:17:44.690133+0000","last_peered":"2023-10-06T04:17:44.690133+0000","last_clean":"2023-10-06T04:17:44.690133+0000","last_became_active":"2023-10-06T04:17:44.027503+0000","last_became_peered":"2023-10-06T04:17:44.027503+0000","last_unstale":"2023-10-06T04:17:44.690133+0000","last_undegraded":"2023-10-06T04:17:44.690133+0000","last_fullsized":"2023-10-06T04:17:44.690133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.695910+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:17:44.695910+0000","last_peered":"2023-10-06T04:17:44.695910+0000","last_clean":"2023-10-06T04:17:44.695910+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:17:44.695910+0000","last_undegraded":"2023-10-06T04:17:44.695910+0000","last_fullsized":"2023-10-06T04:17:44.695910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711531+0000","last_change":"2023-10-06T04:17:44.708278+0000","last_active":"2023-10-06T04:17:44.711531+0000","last_peered":"2023-10-06T04:17:44.711531+0000","last_clean":"2023-10-06T04:17:44.711531+0000","last_became_active":"2023-10-06T04:17:44.708026+0000","last_became_peered":"2023-10-06T04:17:44.708026+0000","last_unstale":"2023-10-06T04:17:44.711531+0000","last_undegraded":"2023-10-06T04:17:44.711531+0000","last_fullsized":"2023-10-06T04:17:44.711531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.690815+0000","last_change":"2023-10-06T04:17:44.031346+0000","last_active":"2023-10-06T04:17:44.690815+0000","last_peered":"2023-10-06T04:17:44.690815+0000","last_clean":"2023-10-06T04:17:44.690815+0000","last_became_active":"2023-10-06T04:17:44.031068+0000","last_became_peered":"2023-10-06T04:17:44.031068+0000","last_unstale":"2023-10-06T04:17:44.690815+0000","last_undegraded":"2023-10-06T04:17:44.690815+0000","last_fullsized":"2023-10-06T04:17:44.690815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:51.483911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.692939+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:17:44.692939+0000","last_peered":"2023-10-06T04:17:44.692939+0000","last_clean":"2023-10-06T04:17:44.692939+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:17:44.692939+0000","last_undegraded":"2023-10-06T04:17:44.692939+0000","last_fullsized":"2023-10-06T04:17:44.692939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714676+0000","last_change":"2023-10-06T04:17:44.712797+0000","last_active":"2023-10-06T04:17:44.714676+0000","last_peered":"2023-10-06T04:17:44.714676+0000","last_clean":"2023-10-06T04:17:44.714676+0000","last_became_active":"2023-10-06T04:17:44.711751+0000","last_became_peered":"2023-10-06T04:17:44.711751+0000","last_unstale":"2023-10-06T04:17:44.714676+0000","last_undegraded":"2023-10-06T04:17:44.714676+0000","last_fullsized":"2023-10-06T04:17:44.714676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:01.873988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693694+0000","last_change":"2023-10-06T04:17:44.029927+0000","last_active":"2023-10-06T04:17:44.693694+0000","last_peered":"2023-10-06T04:17:44.693694+0000","last_clean":"2023-10-06T04:17:44.693694+0000","last_became_active":"2023-10-06T04:17:44.029632+0000","last_became_peered":"2023-10-06T04:17:44.029632+0000","last_unstale":"2023-10-06T04:17:44.693694+0000","last_undegraded":"2023-10-06T04:17:44.693694+0000","last_fullsized":"2023-10-06T04:17:44.693694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:00.045910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693792+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:17:44.693792+0000","last_peered":"2023-10-06T04:17:44.693792+0000","last_clean":"2023-10-06T04:17:44.693792+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:17:44.693792+0000","last_undegraded":"2023-10-06T04:17:44.693792+0000","last_fullsized":"2023-10-06T04:17:44.693792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.711479+0000","last_change":"2023-10-06T04:17:44.708272+0000","last_active":"2023-10-06T04:17:44.711479+0000","last_peered":"2023-10-06T04:17:44.711479+0000","last_clean":"2023-10-06T04:17:44.711479+0000","last_became_active":"2023-10-06T04:17:44.707998+0000","last_became_peered":"2023-10-06T04:17:44.707998+0000","last_unstale":"2023-10-06T04:17:44.711479+0000","last_undegraded":"2023-10-06T04:17:44.711479+0000","last_fullsized":"2023-10-06T04:17:44.711479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:02.427213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704508+0000","last_change":"2023-10-06T04:17:44.032930+0000","last_active":"2023-10-06T04:17:44.704508+0000","last_peered":"2023-10-06T04:17:44.704508+0000","last_clean":"2023-10-06T04:17:44.704508+0000","last_became_active":"2023-10-06T04:17:44.032678+0000","last_became_peered":"2023-10-06T04:17:44.032678+0000","last_unstale":"2023-10-06T04:17:44.704508+0000","last_undegraded":"2023-10-06T04:17:44.704508+0000","last_fullsized":"2023-10-06T04:17:44.704508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:35.808517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693334+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:17:44.693334+0000","last_peered":"2023-10-06T04:17:44.693334+0000","last_clean":"2023-10-06T04:17:44.693334+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:17:44.693334+0000","last_undegraded":"2023-10-06T04:17:44.693334+0000","last_fullsized":"2023-10-06T04:17:44.693334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702156+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:17:44.702156+0000","last_peered":"2023-10-06T04:17:44.702156+0000","last_clean":"2023-10-06T04:17:44.702156+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:17:44.702156+0000","last_undegraded":"2023-10-06T04:17:44.702156+0000","last_fullsized":"2023-10-06T04:17:44.702156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709259+0000","last_change":"2023-10-06T04:17:44.703033+0000","last_active":"2023-10-06T04:17:44.709259+0000","last_peered":"2023-10-06T04:17:44.709259+0000","last_clean":"2023-10-06T04:17:44.709259+0000","last_became_active":"2023-10-06T04:17:44.702726+0000","last_became_peered":"2023-10-06T04:17:44.702726+0000","last_unstale":"2023-10-06T04:17:44.709259+0000","last_undegraded":"2023-10-06T04:17:44.709259+0000","last_fullsized":"2023-10-06T04:17:44.709259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:06.404849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:45.023400+0000","last_change":"2023-10-06T04:17:44.027241+0000","last_active":"2023-10-06T04:17:45.023400+0000","last_peered":"2023-10-06T04:17:45.023400+0000","last_clean":"2023-10-06T04:17:45.023400+0000","last_became_active":"2023-10-06T04:17:44.026691+0000","last_became_peered":"2023-10-06T04:17:44.026691+0000","last_unstale":"2023-10-06T04:17:45.023400+0000","last_undegraded":"2023-10-06T04:17:45.023400+0000","last_fullsized":"2023-10-06T04:17:45.023400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:48.806625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.702060+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:17:44.702060+0000","last_peered":"2023-10-06T04:17:44.702060+0000","last_clean":"2023-10-06T04:17:44.702060+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:17:44.702060+0000","last_undegraded":"2023-10-06T04:17:44.702060+0000","last_fullsized":"2023-10-06T04:17:44.702060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.706272+0000","last_change":"2023-10-06T04:17:44.699433+0000","last_active":"2023-10-06T04:17:44.706272+0000","last_peered":"2023-10-06T04:17:44.706272+0000","last_clean":"2023-10-06T04:17:44.706272+0000","last_became_active":"2023-10-06T04:17:44.699207+0000","last_became_peered":"2023-10-06T04:17:44.699207+0000","last_unstale":"2023-10-06T04:17:44.706272+0000","last_undegraded":"2023-10-06T04:17:44.706272+0000","last_fullsized":"2023-10-06T04:17:44.706272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:41:24.679261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.697498+0000","last_change":"2023-10-06T04:17:44.034627+0000","last_active":"2023-10-06T04:17:44.697498+0000","last_peered":"2023-10-06T04:17:44.697498+0000","last_clean":"2023-10-06T04:17:44.697498+0000","last_became_active":"2023-10-06T04:17:44.034353+0000","last_became_peered":"2023-10-06T04:17:44.034353+0000","last_unstale":"2023-10-06T04:17:44.697498+0000","last_undegraded":"2023-10-06T04:17:44.697498+0000","last_fullsized":"2023-10-06T04:17:44.697498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:20.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.704954+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:17:44.704954+0000","last_peered":"2023-10-06T04:17:44.704954+0000","last_clean":"2023-10-06T04:17:44.704954+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:17:44.704954+0000","last_undegraded":"2023-10-06T04:17:44.704954+0000","last_fullsized":"2023-10-06T04:17:44.704954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.709112+0000","last_change":"2023-10-06T04:17:44.705637+0000","last_active":"2023-10-06T04:17:44.709112+0000","last_peered":"2023-10-06T04:17:44.709112+0000","last_clean":"2023-10-06T04:17:44.709112+0000","last_became_active":"2023-10-06T04:17:44.705088+0000","last_became_peered":"2023-10-06T04:17:44.705088+0000","last_unstale":"2023-10-06T04:17:44.709112+0000","last_undegraded":"2023-10-06T04:17:44.709112+0000","last_fullsized":"2023-10-06T04:17:44.709112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:46.292198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.693786+0000","last_change":"2023-10-06T04:17:44.022775+0000","last_active":"2023-10-06T04:17:44.693786+0000","last_peered":"2023-10-06T04:17:44.693786+0000","last_clean":"2023-10-06T04:17:44.693786+0000","last_became_active":"2023-10-06T04:17:44.022534+0000","last_became_peered":"2023-10-06T04:17:44.022534+0000","last_unstale":"2023-10-06T04:17:44.693786+0000","last_undegraded":"2023-10-06T04:17:44.693786+0000","last_fullsized":"2023-10-06T04:17:44.693786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:46.467077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698472+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:17:44.698472+0000","last_peered":"2023-10-06T04:17:44.698472+0000","last_clean":"2023-10-06T04:17:44.698472+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:17:44.698472+0000","last_undegraded":"2023-10-06T04:17:44.698472+0000","last_fullsized":"2023-10-06T04:17:44.698472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.714738+0000","last_change":"2023-10-06T04:17:44.713362+0000","last_active":"2023-10-06T04:17:44.714738+0000","last_peered":"2023-10-06T04:17:44.714738+0000","last_clean":"2023-10-06T04:17:44.714738+0000","last_became_active":"2023-10-06T04:17:44.712969+0000","last_became_peered":"2023-10-06T04:17:44.712969+0000","last_unstale":"2023-10-06T04:17:44.714738+0000","last_undegraded":"2023-10-06T04:17:44.714738+0000","last_fullsized":"2023-10-06T04:17:44.714738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:44.004287+0000","last_clean_scrub_stamp":"2023-10-06T04:17:44.004287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:18.412497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.698014+0000","last_change":"2023-10-06T04:17:44.022573+0000","last_active":"2023-10-06T04:17:44.698014+0000","last_peered":"2023-10-06T04:17:44.698014+0000","last_clean":"2023-10-06T04:17:44.698014+0000","last_became_active":"2023-10-06T04:17:44.022324+0000","last_became_peered":"2023-10-06T04:17:44.022324+0000","last_unstale":"2023-10-06T04:17:44.698014+0000","last_undegraded":"2023-10-06T04:17:44.698014+0000","last_fullsized":"2023-10-06T04:17:44.698014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:17:42.999041+0000","last_clean_scrub_stamp":"2023-10-06T04:17:42.999041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:44.105159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T04:17:44.696440+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:17:44.696440+0000","last_peered":"2023-10-06T04:17:44.696440+0000","last_clean":"2023-10-06T04:17:44.696440+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:17:44.696440+0000","last_undegraded":"2023-10-06T04:17:44.696440+0000","last_fullsized":"2023-10-06T04:17:44.696440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":748410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":11.148999999999999,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":11.288,"5min":11.288,"15min":11.288},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":11.271000000000001,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.186999999999999,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":11.33,"5min":11.33,"15min":11.33},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.2530000000000001,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":150349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.503},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Oct 6 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":156526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.374},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.441},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":983040,"data_stored":746838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":1.9359999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":1.9690000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":2.6659999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":2.2839999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.319},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":2.0009999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":2.0449999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":149865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.27600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:17:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":158006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.371},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.314},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297660,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074180,"statfs":{"total":96636764160,"available":96331960320,"internally_reserved":0,"allocated":380928,"data_stored":150371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:17:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":156548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.432}]},{"osd":3,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:17:49.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:17:49.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:17:49.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.691+0000 7f125a038700 1 Processor -- start 2023-10-06T04:17:49.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.691+0000 7f125a038700 1 -- start start 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f125a038700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f125406adc0 0x7f12540ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f125a038700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125406f320 con 0x7f12541598c0 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f125a038700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540b1110 con 0x7f1254159c90 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f125a038700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540b23d0 con 0x7f125406adc0 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f12537fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12541598c0 0x7f12540b1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60050/0 (socket says 172.21.15.37:60050) 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.692+0000 7f12537fe700 1 -- 172.21.15.37:0/4167345577 learned_addr learned my addr 172.21.15.37:0/4167345577 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f1253fff700 1 --2- 172.21.15.37:0/4167345577 >> v2:172.21.15.83:3300/0 conn(0x7f125406adc0 0x7f12540ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134387432 0 0) 0x7f125406f320 con 0x7f12541598c0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003570 con 0x7f12541598c0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468460511 0 0) 0x7f12540b1110 con 0x7f1254159c90 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125406f320 con 0x7f1254159c90 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286395586 0 0) 0x7f1240003570 con 0x7f12541598c0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f1253fff700 1 -- 172.21.15.37:0/4167345577 >> v1:172.21.15.83:6789/0 conn(0x7f1254159c90 legacy=0x7f125406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f1253fff700 1 -- 172.21.15.37:0/4167345577 >> v1:172.21.15.37:6789/0 conn(0x7f12541598c0 legacy=0x7f12540b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f1253fff700 1 -- 172.21.15.37:0/4167345577 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540b0500 con 0x7f125406adc0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f1253fff700 1 --2- 172.21.15.37:0/4167345577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540ca1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098e0 tx=0x7f124c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ffa79484a788118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440017f0 con 0x7f125406adc0 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c011420 con 0x7f125406adc0 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.693+0000 7f12527fc700 1 -- 172.21.15.37:0/4167345577 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c0117c0 con 0x7f125406adc0 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 -- 172.21.15.37:0/4167345577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 msgr2=0x7f12540ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 --2- 172.21.15.37:0/4167345577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540ca1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098e0 tx=0x7f124c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 -- 172.21.15.37:0/4167345577 shutdown_connections 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 --2- 172.21.15.37:0/4167345577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540ca1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 -- 172.21.15.37:0/4167345577 >> 172.21.15.37:0/4167345577 conn(0x7f1254068770 msgr2=0x7f1254068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 -- 172.21.15.37:0/4167345577 shutdown_connections 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.694+0000 7f125a038700 1 -- 172.21.15.37:0/4167345577 wait complete. 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.695+0000 7f125a038700 1 Processor -- start 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.695+0000 7f125a038700 1 -- start start 2023-10-06T04:17:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 0x7f125415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540a6bc0 con 0x7f12541598c0 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254155950 con 0x7f125406adc0 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f125a038700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125415cea0 con 0x7f1254159c90 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45662/0 (socket says 172.21.15.37:45662) 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 -- 172.21.15.37:0/205026944 learned_addr learned my addr 172.21.15.37:0/205026944 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1253fff700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 0x7f125415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f12537fe700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 -- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 msgr2=0x7f125415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 0x7f125415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 -- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 msgr2=0x7f12540a5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540a5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 -- 172.21.15.37:0/205026944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c009420 con 0x7f12541598c0 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1253fff700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 0x7f125415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f12537fe700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540a5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.696+0000 7f1252ffd700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e9d0 tx=0x7f123c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.697+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00c9f0 con 0x7f12541598c0 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.697+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00cb50 con 0x7f12541598c0 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.697+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540a5fb0 con 0x7f12541598c0 2023-10-06T04:17:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.697+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011470 con 0x7f12541598c0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.697+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540a6570 con 0x7f12541598c0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.698+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125404c3c0 con 0x7f12541598c0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.698+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f123c011860 con 0x7f12541598c0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.699+0000 7f124b7fe700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 0x7f12340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.699+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f123c0871d0 con 0x7f12541598c0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.699+0000 7f12537fe700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 0x7f12340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.699+0000 7f12537fe700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 0x7f12340693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1244001560 tx=0x7f1244000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.703+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f123c0542e0 con 0x7f12541598c0 2023-10-06T04:17:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.978+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12540a6d00 con 0x7f12541598c0 2023-10-06T04:17:49.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.982+0000 7f124b7fe700 1 -- 172.21.15.37:0/205026944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f123c057900 con 0x7f12541598c0 2023-10-06T04:17:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 msgr2=0x7f12340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 0x7f12340693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1244001560 tx=0x7f1244000f40 comp rx=0 tx=0).stop 2023-10-06T04:17:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 msgr2=0x7f12540a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:49.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e9d0 tx=0x7f123c007e60 comp rx=0 tx=0).stop 2023-10-06T04:17:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 shutdown_connections 2023-10-06T04:17:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1254159c90 0x7f125415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1234066f30 0x7f12340693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f125406adc0 0x7f12540a5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 --2- 172.21.15.37:0/205026944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12541598c0 0x7f12540a7050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 >> 172.21.15.37:0/205026944 conn(0x7f1254068770 msgr2=0x7f12540ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 shutdown_connections 2023-10-06T04:17:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:49.984+0000 7f125a038700 1 -- 172.21.15.37:0/205026944 wait complete. 2023-10-06T04:17:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T04:17:49.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:17:50.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.116+0000 7f97dfec8700 1 Processor -- start 2023-10-06T04:17:50.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.116+0000 7f97dfec8700 1 -- start start 2023-10-06T04:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.116+0000 7f97dfec8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f97d80b5e30 0x7f97d815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dfec8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dfec8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d80ae9f0 con 0x7f97d80b6200 2023-10-06T04:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dfec8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80adde0 con 0x7f97d80b5e30 2023-10-06T04:17:50.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dfec8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80ae0c0 con 0x7f97d80ad800 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97de465700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97ddc64700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f97d80b5e30 0x7f97d815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97de465700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:49318/0 (socket says 172.21.15.37:49318) 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97de465700 1 -- 172.21.15.37:0/4007458232 learned_addr learned my addr 172.21.15.37:0/4007458232 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dd463700 1 --1- 172.21.15.37:0/4007458232 >> v1:172.21.15.83:6789/0 conn(0x7f97d80b6200 0x7f97d80ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:36718/0 (socket says 172.21.15.37:36718) 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97ddc64700 1 -- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 msgr2=0x7f97d815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97ddc64700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97ddc64700 1 -- 172.21.15.37:0/4007458232 >> v1:172.21.15.83:6789/0 conn(0x7f97d80b6200 legacy=0x7f97d80ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97dcc62700 1 -- 172.21.15.37:0/4007458232 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287740974 0 0) 0x7f97d80ae9f0 con 0x7f97d80b6200 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97ddc64700 1 -- 172.21.15.37:0/4007458232 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80ae3a0 con 0x7f97d80b5e30 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.117+0000 7f97de465700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97ddc64700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d815d560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97d00098e0 tx=0x7f97d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4300d70ecc4be104 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dcc62700 1 -- 172.21.15.37:0/4007458232 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000b640 con 0x7f97d80b5e30 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dcc62700 1 -- 172.21.15.37:0/4007458232 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d000b7a0 con 0x7f97d80b5e30 2023-10-06T04:17:50.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dcc62700 1 -- 172.21.15.37:0/4007458232 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d000bb40 con 0x7f97d80b5e30 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 -- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 msgr2=0x7f97d815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d815d560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97d00098e0 tx=0x7f97d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 -- 172.21.15.37:0/4007458232 shutdown_connections 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80ad800 0x7f97d815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 --2- 172.21.15.37:0/4007458232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d815d560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 -- 172.21.15.37:0/4007458232 >> 172.21.15.37:0/4007458232 conn(0x7f97d8099a10 msgr2=0x7f97d806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 -- 172.21.15.37:0/4007458232 shutdown_connections 2023-10-06T04:17:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.118+0000 7f97dfec8700 1 -- 172.21.15.37:0/4007458232 wait complete. 2023-10-06T04:17:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.119+0000 7f97dfec8700 1 Processor -- start 2023-10-06T04:17:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.119+0000 7f97dfec8700 1 -- start start 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d809cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80b6200 0x7f97d809da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d809a4e0 con 0x7f97d80ad800 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d809df70 con 0x7f97d80b5e30 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dfec8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80c54a0 con 0x7f97d80b6200 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97ddc64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97ddc64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45678/0 (socket says 172.21.15.37:45678) 2023-10-06T04:17:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97ddc64700 1 -- 172.21.15.37:0/658595120 learned_addr learned my addr 172.21.15.37:0/658595120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97de465700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80b6200 0x7f97d809da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.120+0000 7f97dd463700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d809cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 -- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80b6200 msgr2=0x7f97d809da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80b6200 0x7f97d809da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 -- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 msgr2=0x7f97d809cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d809cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 -- 172.21.15.37:0/658595120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c8009ae0 con 0x7f97d80ad800 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97ddc64700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97d00093f0 tx=0x7f97d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0000bc0 con 0x7f97d80ad800 2023-10-06T04:17:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d000b910 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0000d20 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d0009420 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.121+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d80c5a60 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.122+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d80b2f90 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.123+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97d0023070 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.123+0000 7f97d5ffb700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.123+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f97d0085870 con 0x7f97d80ad800 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.123+0000 7f97dd463700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.124+0000 7f97dd463700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 0x7f97c40693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97d80af060 tx=0x7f97cc007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.127+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97d0052980 con 0x7f97d80ad800 2023-10-06T04:17:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.365+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97d80ae680 con 0x7f97d80ad800 2023-10-06T04:17:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.366+0000 7f97d5ffb700 1 -- 172.21.15.37:0/658595120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f97d0015090 con 0x7f97d80ad800 2023-10-06T04:17:50.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:50.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 msgr2=0x7f97c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 0x7f97c40693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97d80af060 tx=0x7f97cc007ef0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 msgr2=0x7f97d816a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97d00093f0 tx=0x7f97d0017000 comp rx=0 tx=0).stop 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 shutdown_connections 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f97d80b6200 0x7f97d809da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d80ad800 0x7f97d816a940 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f97c4066f30 0x7f97c40693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 --2- 172.21.15.37:0/658595120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97d80b5e30 0x7f97d809cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 >> 172.21.15.37:0/658595120 conn(0x7f97d8099a10 msgr2=0x7f97d80636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 shutdown_connections 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.368+0000 7f97dfec8700 1 -- 172.21.15.37:0/658595120 wait complete. 2023-10-06T04:17:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:17:50.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:17:44.423753+0000', 'modified': '2023-10-06T04:17:48.038784+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4959}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4959': {'gid': 4959, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/2973556572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2973556572}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2973556572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:17:50.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:17:50.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:17:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.906+0000 7f646682c700 1 Processor -- start 2023-10-06T04:17:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.906+0000 7f646682c700 1 -- start start 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f646682c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6460067d70 0x7f6460164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f646682c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646006e7e0 con 0x7f6460159850 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f646682c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646006eac0 con 0x7f6460159480 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f646682c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646006eda0 con 0x7f6460067d70 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f6464dc9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6460067d70 0x7f6460164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f645f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6460159850 0x7f6460067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60060/0 (socket says 172.21.15.37:60060) 2023-10-06T04:17:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f645f7fe700 1 -- 172.21.15.37:0/35154713 learned_addr learned my addr 172.21.15.37:0/35154713 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f6464dc9700 1 -- 172.21.15.37:0/35154713 >> v1:172.21.15.83:6789/0 conn(0x7f6460159480 legacy=0x7f64600c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f6464dc9700 1 -- 172.21.15.37:0/35154713 >> v1:172.21.15.37:6789/0 conn(0x7f6460159850 legacy=0x7f6460067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f6464dc9700 1 -- 172.21.15.37:0/35154713 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646006f080 con 0x7f6460067d70 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.907+0000 7f645effd700 1 -- 172.21.15.37:0/35154713 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223861147 0 0) 0x7f646006e7e0 con 0x7f6460159850 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f6464dc9700 1 --2- 172.21.15.37:0/35154713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460067d70 0x7f6460164700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6458009e60 tx=0x7f6458009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f67373aa519ec64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f645effd700 1 -- 172.21.15.37:0/35154713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800e070 con 0x7f6460067d70 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f645effd700 1 -- 172.21.15.37:0/35154713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645800bc30 con 0x7f6460067d70 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f645effd700 1 -- 172.21.15.37:0/35154713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458012430 con 0x7f6460067d70 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 -- 172.21.15.37:0/35154713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460067d70 msgr2=0x7f6460164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 --2- 172.21.15.37:0/35154713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460067d70 0x7f6460164700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6458009e60 tx=0x7f6458009780 comp rx=0 tx=0).stop 2023-10-06T04:17:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 -- 172.21.15.37:0/35154713 shutdown_connections 2023-10-06T04:17:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 --2- 172.21.15.37:0/35154713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460067d70 0x7f6460164700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 -- 172.21.15.37:0/35154713 >> 172.21.15.37:0/35154713 conn(0x7f64600cddd0 msgr2=0x7f64600c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 -- 172.21.15.37:0/35154713 shutdown_connections 2023-10-06T04:17:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.908+0000 7f646682c700 1 -- 172.21.15.37:0/35154713 wait complete. 2023-10-06T04:17:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.909+0000 7f646682c700 1 Processor -- start 2023-10-06T04:17:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 -- start start 2023-10-06T04:17:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6460067d70 0x7f64600b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6460159480 0x7f64600ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600aa7b0 con 0x7f6460159850 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600c6d40 con 0x7f6460159480 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f646682c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600b2f90 con 0x7f6460067d70 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45696/0 (socket says 172.21.15.37:45696) 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.910+0000 7f6464dc9700 1 -- 172.21.15.37:0/3574624863 learned_addr learned my addr 172.21.15.37:0/3574624863 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f645f7fe700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6460159480 0x7f64600ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f645ffff700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6460067d70 0x7f64600b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 -- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6460067d70 msgr2=0x7f64600b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6460067d70 0x7f64600b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 -- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6460159480 msgr2=0x7f64600ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6460159480 0x7f64600ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 -- 172.21.15.37:0/3574624863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458009a20 con 0x7f6460159850 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f645800b6c0 tx=0x7f6458019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6457fff700 1 -- 172.21.15.37:0/3574624863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645801b420 con 0x7f6460159850 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6457fff700 1 -- 172.21.15.37:0/3574624863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645801b580 con 0x7f6460159850 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646016d670 con 0x7f6460159850 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f6457fff700 1 -- 172.21.15.37:0/3574624863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645801b940 con 0x7f6460159850 2023-10-06T04:17:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.911+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600aa1f0 con 0x7f6460159850 2023-10-06T04:17:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.913+0000 7f6457fff700 1 -- 172.21.15.37:0/3574624863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f645801bcb0 con 0x7f6460159850 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.913+0000 7f6457fff700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.913+0000 7f6457fff700 1 -- 172.21.15.37:0/3574624863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6458086430 con 0x7f6460159850 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.913+0000 7f645ffff700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.914+0000 7f645ffff700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 0x7f64400693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6448003a80 tx=0x7f6448007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.915+0000 7f646fb24b80 1 Processor -- start 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.915+0000 7f646fb24b80 1 -- start start 2023-10-06T04:17:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb4080c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3fd7a70 con 0x55bbb40d0c00 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3fd5270 con 0x55bbb4081cc0 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3fd1060 con 0x55bbb4080840 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f645ffff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb4080c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45710/0 (socket says 172.21.15.37:45710) 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 -- 172.21.15.37:0/3002490586 learned_addr learned my addr 172.21.15.37:0/3002490586 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f645f7fe700 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 -- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 msgr2=0x55bbb4080c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb4080c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 -- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 msgr2=0x55bbb40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb40d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 -- 172.21.15.37:0/3002490586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbb3e6b270 con 0x55bbb40d0c00 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f645f7fe700 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f6464dc9700 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6458057190 tx=0x7f6458084750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d472c308264dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.916+0000 7f64557fa700 1 -- 172.21.15.37:0/3002490586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800e040 con 0x55bbb40d0c00 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f64557fa700 1 -- 172.21.15.37:0/3002490586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458057200 con 0x55bbb40d0c00 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f64557fa700 1 -- 172.21.15.37:0/3002490586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458057980 con 0x55bbb40d0c00 2023-10-06T04:17:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 -- 172.21.15.37:0/3002490586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 msgr2=0x55bbb40d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6458057190 tx=0x7f6458084750 comp rx=0 tx=0).stop 2023-10-06T04:17:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 -- 172.21.15.37:0/3002490586 shutdown_connections 2023-10-06T04:17:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40d1050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb4080c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 --2- 172.21.15.37:0/3002490586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 -- 172.21.15.37:0/3002490586 >> 172.21.15.37:0/3002490586 conn(0x55bbb4082160 msgr2=0x55bbb4082530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 -- 172.21.15.37:0/3002490586 shutdown_connections 2023-10-06T04:17:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.917+0000 7f646fb24b80 1 -- 172.21.15.37:0/3002490586 wait complete. 2023-10-06T04:17:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.918+0000 7f646fb24b80 1 -- start start 2023-10-06T04:17:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.918+0000 7f646fb24b80 1 Processor -- start 2023-10-06T04:17:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3f7c890 con 0x55bbb4081cc0 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3f97ea0 con 0x55bbb40d0c00 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbb3e53e30 con 0x55bbb4080840 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f646fb24b80 10 client.0 _ll_register_callbacks cb 0x55bbb4043e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45722/0 (socket says 172.21.15.37:45722) 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 -- 172.21.15.37:0/2814117511 learned_addr learned my addr 172.21.15.37:0/2814117511 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f6464dc9700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645ffff700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 -- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 msgr2=0x55bbb40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 -- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 msgr2=0x55bbb40cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 -- 172.21.15.37:0/2814117511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600aa1f0 con 0x55bbb4081cc0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f645f7fe700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6450007930 tx=0x7f6450009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b34487f7e420ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.919+0000 7f643e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450001da0 con 0x55bbb4081cc0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6450006050 con 0x55bbb4081cc0 2023-10-06T04:17:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbb4075940 con 0x55bbb4081cc0 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6450006420 con 0x55bbb4081cc0 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 10 client.5139 fetch_fsmap learned FSMap version 17 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bbb3e0dfe0 con 0x55bbb4081cc0 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450025020 con 0x55bbb4081cc0 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6450006580 con 0x55bbb4081cc0 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 10 client.5139 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 10 client.5139 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 20 client.5139 populate_metadata read hostname 'smithi037' 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb40c1400 0x55bbb40c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 4 client.5139 mds_command: new command op to 4959 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 --> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbb4052870 con 0x55bbb40c1400 2023-10-06T04:17:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.920+0000 7f645ffff700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb40c1400 0x55bbb40c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f645ffff700 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb40c1400 0x55bbb40c17d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e893586220d57307 server_cookie=c51eb6e8b27d3364 in_seq=0 out_seq=0 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f643e7fc700 10 client.5139 ms_handle_connect on v2:172.21.15.37:6834/2973556572 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f643e7fc700 1 -- 172.21.15.37:0/2814117511 <== mds.0 v2:172.21.15.37:6834/2973556572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55bbb4052870 con 0x55bbb40c1400 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f643e7fc700 10 client.5139 handle_command_reply: tid=0 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 client.5139 shutdown 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 msgr2=0x55bbb40bea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6450007930 tx=0x7f6450009040 comp rx=0 tx=0).stop 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 shutdown_connections 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb40c1400 0x55bbb40c17d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f643e7fc700 0 client.5139 ms_handle_reset on v2:172.21.15.37:6834/2973556572 2023-10-06T04:17:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2814117511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4081cc0 0x55bbb40bea10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 >> 172.21.15.37:0/2814117511 conn(0x55bbb4082160 msgr2=0x55bbb40811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 shutdown_connections 2023-10-06T04:17:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 1 -- 172.21.15.37:0/2814117511 wait complete. 2023-10-06T04:17:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.921+0000 7f646fb24b80 20 client.5139 trim_cache size 0 max 16384 2023-10-06T04:17:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.938+0000 7f646fb24b80 1 Processor -- start 2023-10-06T04:17:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.938+0000 7f646fb24b80 1 -- start start 2023-10-06T04:17:50.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb407ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb4081250 con 0x55bbb40d0c00 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb40ca5b0 con 0x55bbb4081cc0 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbb40591e0 con 0x55bbb4080840 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45726/0 (socket says 172.21.15.37:45726) 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 -- 172.21.15.37:0/2705314290 learned_addr learned my addr 172.21.15.37:0/2705314290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f645ffff700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f645f7fe700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb407ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 -- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 msgr2=0x55bbb40b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 -- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 msgr2=0x55bbb407ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb407ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f6464dc9700 1 -- 172.21.15.37:0/2705314290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbb3f9f780 con 0x55bbb40d0c00 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.939+0000 7f645ffff700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f6464dc9700 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6458057190 tx=0x7f645806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6dda693a86304b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f6455ffb700 1 -- 172.21.15.37:0/2705314290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800e070 con 0x55bbb40d0c00 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f6455ffb700 1 -- 172.21.15.37:0/2705314290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645805a450 con 0x55bbb40d0c00 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f6455ffb700 1 -- 172.21.15.37:0/2705314290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645805e1a0 con 0x55bbb40d0c00 2023-10-06T04:17:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 -- 172.21.15.37:0/2705314290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 msgr2=0x55bbb40c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6458057190 tx=0x7f645806b000 comp rx=0 tx=0).stop 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 -- 172.21.15.37:0/2705314290 shutdown_connections 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb40d0c00 0x55bbb40c46a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4080840 0x55bbb40b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 --2- 172.21.15.37:0/2705314290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb4081cc0 0x55bbb407ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 -- 172.21.15.37:0/2705314290 >> 172.21.15.37:0/2705314290 conn(0x55bbb4082160 msgr2=0x55bbb4079280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 -- 172.21.15.37:0/2705314290 shutdown_connections 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.940+0000 7f646fb24b80 1 -- 172.21.15.37:0/2705314290 wait complete. 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.941+0000 7f646fb24b80 1 -- start start 2023-10-06T04:17:50.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.941+0000 7f646fb24b80 1 Processor -- start 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 0x55bbb407c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb40c91d0 con 0x55bbb4080840 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb40c88a0 con 0x55bbb40d0c00 2023-10-06T04:17:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbb40c8b80 con 0x55bbb4081cc0 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f646fb24b80 10 client.0 _ll_register_callbacks cb 0x55bbb4043e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45732/0 (socket says 172.21.15.37:45732) 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 -- 172.21.15.37:0/334584502 learned_addr learned my addr 172.21.15.37:0/334584502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645f7fe700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 0x55bbb407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f6464dc9700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 -- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 msgr2=0x55bbb407c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 0x55bbb407c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 -- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 msgr2=0x55bbb40c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 -- 172.21.15.37:0/334584502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbb3e6b270 con 0x55bbb4080840 2023-10-06T04:17:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645f7fe700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 0x55bbb407c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f6464dc9700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f645ffff700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6448003ef0 tx=0x7f6448025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bee39f43a9750c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.942+0000 7f643e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448028030 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6458057200 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f644801c040 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6448014e50 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 10 client.5145 fetch_fsmap learned FSMap version 17 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bbb3f86470 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458057200 con 0x55bbb4080840 2023-10-06T04:17:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6448002050 con 0x55bbb4080840 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 10 client.5145 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 10 client.5145 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 20 client.5145 populate_metadata read hostname 'smithi037' 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb412c640 0x55bbb412ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 4 client.5145 mds_command: new command op to 4959 tid=0[{"prefix": "status"}] 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 --> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bbb3f73e00 con 0x55bbb412c640 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f645f7fe700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb412c640 0x55bbb412ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f643e7fc700 10 client.5145 ms_handle_connect on v2:172.21.15.37:6834/2973556572 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.943+0000 7f645f7fe700 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb412c640 0x55bbb412ca10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c236f938480424 server_cookie=a2a90698833ea59f in_seq=0 out_seq=0 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f643e7fc700 1 -- 172.21.15.37:0/334584502 <== mds.0 v2:172.21.15.37:6834/2973556572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55bbb3f73e00 con 0x55bbb412c640 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f643e7fc700 10 client.5145 handle_command_reply: tid=0 2023-10-06T04:17:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 client.5145 shutdown 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 msgr2=0x55bbb407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6448003ef0 tx=0x7f6448025040 comp rx=0 tx=0).stop 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 shutdown_connections 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bbb40d0c00 0x55bbb40c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbb4080840 0x55bbb407c3f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.37:6834/2973556572,v1:172.21.15.37:6835/2973556572] conn(0x55bbb412c640 0x55bbb412ca10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 --2- 172.21.15.37:0/334584502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55bbb4081cc0 0x55bbb407c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f643e7fc700 0 client.5145 ms_handle_reset on v2:172.21.15.37:6834/2973556572 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 >> 172.21.15.37:0/334584502 conn(0x55bbb4082160 msgr2=0x55bbb4083a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 shutdown_connections 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 1 -- 172.21.15.37:0/334584502 wait complete. 2023-10-06T04:17:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646fb24b80 20 client.5145 trim_cache size 0 max 16384 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "40813f02-7e3b-4d33-ae21-8c35b4fd9578", 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4959, 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T04:17:50.954 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.9307456109999999, 2023-10-06T04:17:50.955 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2023-10-06T04:17:50.955 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 34, 2023-10-06T04:17:50.955 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 34, 2023-10-06T04:17:50.955 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 13.81125112 2023-10-06T04:17:50.955 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 msgr2=0x7f64400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 0x7f64400693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6448003a80 tx=0x7f6448007ec0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 msgr2=0x7f646016db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f645800b6c0 tx=0x7f6458019000 comp rx=0 tx=0).stop 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 shutdown_connections 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460159850 0x7f646016db00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6460067d70 0x7f64600b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6440066f30 0x7f64400693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 --2- 172.21.15.37:0/3574624863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6460159480 0x7f64600ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.944+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 >> 172.21.15.37:0/3574624863 conn(0x7f64600cddd0 msgr2=0x7f6460155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.945+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 shutdown_connections 2023-10-06T04:17:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:50.945+0000 7f646682c700 1 -- 172.21.15.37:0/3574624863 wait complete. 2023-10-06T04:17:50.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:17:51.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.075+0000 7fccad6eb700 1 Processor -- start 2023-10-06T04:17:51.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.075+0000 7fccad6eb700 1 -- start start 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fccad6eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcca815dc70 0x7fcca80ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fccad6eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fccad6eb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca80ae9f0 con 0x7fcca80b5e30 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fccad6eb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca80adb70 con 0x7fcca815dc70 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fccad6eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80adde0 con 0x7fcca80b6200 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcca815dc70 0x7fcca80ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcca815dc70 0x7fcca80ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45742/0 (socket says 172.21.15.37:45742) 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 -- 172.21.15.37:0/1557679912 learned_addr learned my addr 172.21.15.37:0/1557679912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:51.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca77fe700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 -- 172.21.15.37:0/1557679912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 msgr2=0x7fcca80ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca80ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 -- 172.21.15.37:0/1557679912 >> v1:172.21.15.83:6789/0 conn(0x7fcca80b5e30 legacy=0x7fcca815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 -- 172.21.15.37:0/1557679912 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80ae0c0 con 0x7fcca815dc70 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca5ffb700 1 -- 172.21.15.37:0/1557679912 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545669394 0 0) 0x7fcca80ae9f0 con 0x7fcca80b5e30 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.076+0000 7fcca67fc700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca80ad0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc980099b0 tx=0x7fcc98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f1af97eebb48f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fcca5ffb700 1 -- 172.21.15.37:0/1557679912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98009ea0 con 0x7fcca815dc70 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fcca5ffb700 1 -- 172.21.15.37:0/1557679912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800b860 con 0x7fcca815dc70 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fcca5ffb700 1 -- 172.21.15.37:0/1557679912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800bc20 con 0x7fcca815dc70 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 -- 172.21.15.37:0/1557679912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 msgr2=0x7fcca80ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca80ad0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc980099b0 tx=0x7fcc98009250 comp rx=0 tx=0).stop 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 -- 172.21.15.37:0/1557679912 shutdown_connections 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca80ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 --2- 172.21.15.37:0/1557679912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca80ad0f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 -- 172.21.15.37:0/1557679912 >> 172.21.15.37:0/1557679912 conn(0x7fcca8099a10 msgr2=0x7fcca806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 -- 172.21.15.37:0/1557679912 shutdown_connections 2023-10-06T04:17:51.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.077+0000 7fccad6eb700 1 -- 172.21.15.37:0/1557679912 wait complete. 2023-10-06T04:17:51.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.078+0000 7fccad6eb700 1 Processor -- start 2023-10-06T04:17:51.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.078+0000 7fccad6eb700 1 -- start start 2023-10-06T04:17:51.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca80b5e30 0x7fcca81504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8152170 con 0x7fcca815dc70 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca815b930 con 0x7fcca80b5e30 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fccad6eb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca815bc10 con 0x7fcca80b6200 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fcca77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fcca77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45744/0 (socket says 172.21.15.37:45744) 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fcca77fe700 1 -- 172.21.15.37:0/2017314538 learned_addr learned my addr 172.21.15.37:0/2017314538 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fcca67fc700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.079+0000 7fcca6ffd700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca80b5e30 0x7fcca81504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 -- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 msgr2=0x7fcca809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 -- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca80b5e30 msgr2=0x7fcca81504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca80b5e30 0x7fcca81504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 -- 172.21.15.37:0/2017314538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094f0 con 0x7fcca815dc70 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcca77fe700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009ef0 tx=0x7fcca000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000cb70 con 0x7fcca815dc70 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000f040 con 0x7fcca815dc70 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0014480 con 0x7fcca815dc70 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca815bef0 con 0x7fcca815dc70 2023-10-06T04:17:51.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.080+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca809b3c0 con 0x7fcca815dc70 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.081+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8151f40 con 0x7fcca815dc70 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.081+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcca0014830 con 0x7fcca815dc70 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.082+0000 7fcc8effd700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.082+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcca0085360 con 0x7fcca815dc70 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.082+0000 7fcca6ffd700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:17:51.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.082+0000 7fcca6ffd700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 0x7fcc940693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c007fd0 tx=0x7fcc9c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:17:51.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.086+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcca8151f40 con 0x7fcca815dc70 2023-10-06T04:17:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.325+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcca8151f40 con 0x7fcca815dc70 2023-10-06T04:17:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.325+0000 7fcc8effd700 1 -- 172.21.15.37:0/2017314538 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcca8151f40 con 0x7fcca815dc70 2023-10-06T04:17:51.327 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 msgr2=0x7fcc940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 0x7fcc940693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c007fd0 tx=0x7fcc9c007d30 comp rx=0 tx=0).stop 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 msgr2=0x7fcca815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009ef0 tx=0x7fcca000b040 comp rx=0 tx=0).stop 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 shutdown_connections 2023-10-06T04:17:51.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcca815dc70 0x7fcca815afe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcca80b5e30 0x7fcca81504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 --2- 172.21.15.37:0/2017314538 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcca80b6200 0x7fcca809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 >> 172.21.15.37:0/2017314538 conn(0x7fcca8099a10 msgr2=0x7fcca8151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 shutdown_connections 2023-10-06T04:17:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:17:51.327+0000 7fccad6eb700 1 -- 172.21.15.37:0/2017314538 wait complete. 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:17:51.341 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:17:51.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.342 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T04:17:51.357 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:17:51.357 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:51.358 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42384sec preferred_lft 42384sec 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T04:17:51.359 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 2a:0c:3b:32:21:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::10fa:95ff:fe1a:759b/64 scope link 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:75:ee:67:65:08 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::3475:eeff:fe67:6508/64 scope link 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:17:51.360 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 2a:0c:3b:32:21:f0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:17:51.361 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::280c:3bff:fe32:21f0/64 scope link 2023-10-06T04:17:51.361 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:17:51.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.361 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:17:51.421 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T04:17:51.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.422 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:17:51.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:17:51.480 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T04:17:51.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.582 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:17:51.596 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:17:51.597 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:17:51.597 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:17:51.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T04:17:51.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:51.662 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:51.717 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:17:51.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:17:51.718 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:51.772 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:17:51.772 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:17:51.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:51.853 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:51.853 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:51.853 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:51.861 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:51.862 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:51.862 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:51.862 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:51.862 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-10-06T04:17:51.884 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=40813f02-7e3b-4d33-ae21-8c35b4fd9578" will pass to kernel 2023-10-06T04:17:51.886 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:17:51.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:17:51.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:17:51.952 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=xfstests-dev 2023-10-06T04:17:52.007 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.9DYHaiFvvixfstests-dev 2023-10-06T04:17:52.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:52.008 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.9DYHaiFvvixfstests-dev) 2023-10-06T04:17:52.065 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/tmp/tmp.9DYHaiFvvixfstests-dev'... 2023-10-06T04:17:52.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:52.762 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-06T04:17:52.821 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=test 2023-10-06T04:17:52.876 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.29145vvKODtest 2023-10-06T04:17:52.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:52.876 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/test /tmp/tmp.29145vvKODtest) 2023-10-06T04:17:52.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:52.942 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-06T04:17:52.999 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=scratch 2023-10-06T04:17:53.055 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.7UtGTcTfcmscratch 2023-10-06T04:17:53.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:17:53.252 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/scratch /tmp/tmp.7UtGTcTfcmscratch) 2023-10-06T04:17:53.287 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.4". 2023-10-06T04:17:53.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-10-06T04:17:53.728 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T04:17:54.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:17:54.215 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:17:54.610 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:15 ago on Fri 06 Oct 2023 04:13:39 AM UTC. 2023-10-06T04:17:56.201 INFO:teuthology.orchestra.run.smithi037.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:17:56.202 INFO:teuthology.orchestra.run.smithi037.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:17:56.203 INFO:teuthology.orchestra.run.smithi037.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-10-06T04:17:56.204 INFO:teuthology.orchestra.run.smithi037.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-10-06T04:17:56.205 INFO:teuthology.orchestra.run.smithi037.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-10-06T04:17:56.206 INFO:teuthology.orchestra.run.smithi037.stdout:Package e2fsprogs-1.45.6-1.el8.x86_64 is already installed. 2023-10-06T04:17:56.208 INFO:teuthology.orchestra.run.smithi037.stdout:Package gawk-4.2.1-2.el8.x86_64 is already installed. 2023-10-06T04:17:56.209 INFO:teuthology.orchestra.run.smithi037.stdout:Package gcc-8.4.1-1.el8.x86_64 is already installed. 2023-10-06T04:17:56.211 INFO:teuthology.orchestra.run.smithi037.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-10-06T04:17:56.212 INFO:teuthology.orchestra.run.smithi037.stdout:Package lvm2-8:2.03.11-5.el8.x86_64 is already installed. 2023-10-06T04:17:56.212 INFO:teuthology.orchestra.run.smithi037.stdout:Package make-1:4.2.1-10.el8.x86_64 is already installed. 2023-10-06T04:17:56.214 INFO:teuthology.orchestra.run.smithi037.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-10-06T04:17:56.214 INFO:teuthology.orchestra.run.smithi037.stdout:Package quota-1:4.04-12.el8.x86_64 is already installed. 2023-10-06T04:17:56.215 INFO:teuthology.orchestra.run.smithi037.stdout:Package sed-4.5-2.el8.x86_64 is already installed. 2023-10-06T04:17:56.216 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:17:56.217 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:17:56.218 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:17:56.219 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:17:56.220 INFO:teuthology.orchestra.run.smithi037.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-10-06T04:17:56.221 INFO:teuthology.orchestra.run.smithi037.stdout:Package libuuid-devel-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:17:56.222 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-devel-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:17:56.223 INFO:teuthology.orchestra.run.smithi037.stdout:Package sqlite-3.26.0-13.el8.x86_64 is already installed. 2023-10-06T04:17:56.227 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:17:56.729 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-06T04:17:56.730 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================================== 2023-10-06T04:17:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================================== 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: python2 x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 109 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 78 k 2023-10-06T04:17:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: python2-libs x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-wheel noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.7 M 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling module streams: 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: python27 2.7 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================================== 2023-10-06T04:17:56.732 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2023-10-06T04:17:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:17:56.733 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 11 M 2023-10-06T04:17:56.733 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 41 M 2023-10-06T04:17:56.733 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-10-06T04:17:57.015 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): python2-pip-9.0.3-18.module+el8.3.0+770 26 MB/s | 1.7 MB 00:00 2023-10-06T04:17:57.019 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python2-pip-wheel-9.0.3-18.module+el8.3 14 MB/s | 1.0 MB 00:00 2023-10-06T04:17:57.042 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): libpmemblk-1.6.1-1.el8.x86_64.rpm 3.3 MB/s | 92 kB 00:00 2023-10-06T04:17:57.052 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): fio-3.19-3.el8.x86_64.rpm 16 MB/s | 538 kB 00:00 2023-10-06T04:17:57.080 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python2-2.7.18-4.module+el8.4.0+9577+0b 2.9 MB/s | 109 kB 00:00 2023-10-06T04:17:57.097 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python2-setuptools-39.0.1-13.module+el8 14 MB/s | 642 kB 00:00 2023-10-06T04:17:57.129 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python2-setuptools-wheel-39.0.1-13.modu 8.8 MB/s | 287 kB 00:00 2023-10-06T04:17:57.156 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): dump-0.4-0.36.b46.el8.x86_64.rpm 6.0 MB/s | 164 kB 00:00 2023-10-06T04:17:57.188 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python2-libs-2.7.18-4.module+el8.4.0+95 55 MB/s | 6.0 MB 00:00 2023-10-06T04:17:57.189 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): rmt-1.5.3-13.el8.x86_64.rpm 1.5 MB/s | 51 kB 00:00 2023-10-06T04:17:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): daxctl-libs-71.1-2.el8.x86_64.rpm 1.7 MB/s | 42 kB 00:00 2023-10-06T04:17:57.216 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): ndctl-libs-71.1-2.el8.x86_64.rpm 2.9 MB/s | 78 kB 00:00 2023-10-06T04:17:57.425 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): indent-2.2.13-4.el8.x86_64.rpm 391 kB/s | 187 kB 00:00 2023-10-06T04:17:57.425 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:17:57.425 INFO:teuthology.orchestra.run.smithi037.stdout:Total 16 MB/s | 11 MB 00:00 2023-10-06T04:17:57.441 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-10-06T04:17:57.469 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-10-06T04:17:57.469 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-10-06T04:17:57.712 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-10-06T04:17:57.718 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-10-06T04:17:58.346 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-10-06T04:17:58.517 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T04:17:58.590 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T04:17:58.767 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T04:17:58.825 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T04:17:59.017 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T04:17:59.101 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T04:17:59.288 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/13 2023-10-06T04:17:59.576 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 5/13 2023-10-06T04:17:59.935 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 6/13 2023-10-06T04:18:01.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/13 2023-10-06T04:18:01.749 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 8/13 2023-10-06T04:18:01.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 9/13 2023-10-06T04:18:02.492 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 9/13 2023-10-06T04:18:02.795 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 10/13 2023-10-06T04:18:03.097 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/13 2023-10-06T04:18:03.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-3.19-3.el8.x86_64 12/13 2023-10-06T04:18:03.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T04:18:03.973 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T04:18:03.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/13 2023-10-06T04:18:03.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 2/13 2023-10-06T04:18:03.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 3/13 2023-10-06T04:18:03.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 4/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-3.19-3.el8.x86_64 5/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 6/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 8/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 9/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 10/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 11/13 2023-10-06T04:18:03.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : daxctl-libs-71.1-2.el8.x86_64 12/13 2023-10-06T04:18:05.221 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ndctl-libs-71.1-2.el8.x86_64 13/13 2023-10-06T04:18:05.221 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:26 ago on Fri 06 Oct 2023 04:13:39 AM UTC. 2023-10-06T04:18:07.275 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs-71.1-2.el8.x86_64 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: fio-3.19-3.el8.x86_64 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: indent-2.2.13-4.el8.x86_64 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-10-06T04:18:07.388 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs-71.1-2.el8.x86_64 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:18:07.389 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-06T04:18:07.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd fsgqa 2023-10-06T04:18:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:useradd: user 'fsgqa' already exists 2023-10-06T04:18:07.551 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T04:18:07.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo groupadd fsgqa 2023-10-06T04:18:07.617 INFO:teuthology.orchestra.run.smithi037.stderr:groupadd: group 'fsgqa' already exists 2023-10-06T04:18:07.617 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T04:18:07.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd 123456-fsgqa 2023-10-06T04:18:10.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-06T04:18:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.316+0000 7f479211e700 1 Processor -- start 2023-10-06T04:18:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.316+0000 7f479211e700 1 -- start start 2023-10-06T04:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f479211e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 0x7f478c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f479211e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f478c150500 0x7f478c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f479211e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c0a9860 con 0x7f478c0a93c0 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f479211e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c0a9b40 con 0x7f478c150500 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f479211e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0a9e20 con 0x7f478c06f230 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f478affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f478c0a93c0 0x7f478c14fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42010/0 (socket says 172.21.15.37:42010) 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.317+0000 7f478affd700 1 -- 172.21.15.37:0/3169466992 learned_addr learned my addr 172.21.15.37:0/3169466992 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 --2- 172.21.15.37:0/3169466992 >> v2:172.21.15.83:3300/0 conn(0x7f478c150500 0x7f478c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478b7fe700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 0x7f478c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576368362 0 0) 0x7f478c0a9860 con 0x7f478c0a93c0 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4774003570 con 0x7f478c0a93c0 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 -- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 msgr2=0x7f478c0a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:18:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 0x7f478c0a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 -- 172.21.15.37:0/3169466992 >> v1:172.21.15.37:6789/0 conn(0x7f478c0a93c0 legacy=0x7f478c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315855253 0 0) 0x7f4774003570 con 0x7f478c0a93c0 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 -- 172.21.15.37:0/3169466992 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c1574f0 con 0x7f478c150500 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478b7fe700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 0x7f478c0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478bfff700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c150500 0x7f478c157cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4784009d50 tx=0x7f4784009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5676ff99e47a48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780001470 con 0x7f478c150500 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400c8b0 con 0x7f478c150500 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.318+0000 7f478a7fc700 1 -- 172.21.15.37:0/3169466992 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400cc70 con 0x7f478c150500 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 -- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c150500 msgr2=0x7f478c157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c150500 0x7f478c157cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4784009d50 tx=0x7f4784009780 comp rx=0 tx=0).stop 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 -- 172.21.15.37:0/3169466992 shutdown_connections 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c150500 0x7f478c157cf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 --2- 172.21.15.37:0/3169466992 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c06f230 0x7f478c0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 -- 172.21.15.37:0/3169466992 >> 172.21.15.37:0/3169466992 conn(0x7f478c0cc250 msgr2=0x7f478c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 -- 172.21.15.37:0/3169466992 shutdown_connections 2023-10-06T04:18:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.319+0000 7f479211e700 1 -- 172.21.15.37:0/3169466992 wait complete. 2023-10-06T04:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.320+0000 7f479211e700 1 Processor -- start 2023-10-06T04:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.320+0000 7f479211e700 1 -- start start 2023-10-06T04:18:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c0a93c0 0x7f478c14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c150500 0x7f478c14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c16a850 con 0x7f478c06f230 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c098ce0 con 0x7f478c0a93c0 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f479211e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0998b0 con 0x7f478c150500 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58948/0 (socket says 172.21.15.37:58948) 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 -- 172.21.15.37:0/1260567846 learned_addr learned my addr 172.21.15.37:0/1260567846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478bfff700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c150500 0x7f478c14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478affd700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c0a93c0 0x7f478c14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 -- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c150500 msgr2=0x7f478c14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c150500 0x7f478c14e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 -- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c0a93c0 msgr2=0x7f478c14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c0a93c0 0x7f478c14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.321+0000 7f478b7fe700 1 -- 172.21.15.37:0/1260567846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0093c0 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f478b7fe700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f477c00ec80 tx=0x7f477c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c005a00 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c005b60 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478400d040 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00c9d0 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.322+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c16d050 con 0x7f478c06f230 2023-10-06T04:18:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.323+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c063410 con 0x7f478c06f230 2023-10-06T04:18:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.323+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f477c00cd80 con 0x7f478c06f230 2023-10-06T04:18:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.324+0000 7f47737fe700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.324+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f477c084cc0 con 0x7f478c06f230 2023-10-06T04:18:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.324+0000 7f478affd700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.324+0000 7f478affd700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 0x7f47780693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f478c06ac50 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.328+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f477c051dd0 con 0x7f478c06f230 2023-10-06T04:18:10.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.604+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f478c159690 con 0x7f478c06f230 2023-10-06T04:18:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.605+0000 7f47737fe700 1 -- 172.21.15.37:0/1260567846 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1263 (secure 0 0 0) 0x7f477c020020 con 0x7f478c06f230 2023-10-06T04:18:10.606 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:18:10.606 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","modified":"2023-10-06T04:15:55.847143Z","created":"2023-10-06T04:15:55.847143Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3301","nonce":0},{"type":"v1","addr":"172.21.15.83:6790","nonce":0}]},"addr":"172.21.15.83:6790/0","public_addr":"172.21.15.83:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-06T04:18:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.606+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 msgr2=0x7f47780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.606+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 0x7f47780693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f478c06ac50 tx=0x7f4780009040 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.606+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 msgr2=0x7f478c099370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.606+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f477c00ec80 tx=0x7f477c009120 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 shutdown_connections 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f478c150500 0x7f478c14e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f478c06f230 0x7f478c099370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4778066f30 0x7f47780693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 --2- 172.21.15.37:0/1260567846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f478c0a93c0 0x7f478c14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 >> 172.21.15.37:0/1260567846 conn(0x7f478c0cc250 msgr2=0x7f478c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 shutdown_connections 2023-10-06T04:18:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.607+0000 7f479211e700 1 -- 172.21.15.37:0/1260567846 wait complete. 2023-10-06T04:18:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2023-10-06T04:18:10.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-06T04:18:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.739+0000 7f57ba81b700 1 Processor -- start 2023-10-06T04:18:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 -- start start 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57b40b0710 0x7f57b415be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 0x7f57b406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b415b420 con 0x7f57b4157500 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b415b9e0 con 0x7f57b40b0710 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57ba81b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4157cf0 con 0x7f57b41578d0 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57b37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57b40b0710 0x7f57b415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57b37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57b40b0710 0x7f57b415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58964/0 (socket says 172.21.15.37:58964) 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.740+0000 7f57b37fe700 1 -- 172.21.15.37:0/1152588176 learned_addr learned my addr 172.21.15.37:0/1152588176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b8db8700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 0x7f57b406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b37fe700 1 -- 172.21.15.37:0/1152588176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 msgr2=0x7f57b406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b37fe700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 0x7f57b406baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b37fe700 1 -- 172.21.15.37:0/1152588176 >> v1:172.21.15.83:6789/0 conn(0x7f57b4157500 legacy=0x7f57b40b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b37fe700 1 -- 172.21.15.37:0/1152588176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40b0ba0 con 0x7f57b40b0710 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b8db8700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 0x7f57b406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b37fe700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b40b0710 0x7f57b415be70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f579c0099b0 tx=0x7f579c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adf49ad073f3039 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b2ffd700 1 -- 172.21.15.37:0/1152588176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00b860 con 0x7f57b40b0710 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b2ffd700 1 -- 172.21.15.37:0/1152588176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00b9c0 con 0x7f57b40b0710 2023-10-06T04:18:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.741+0000 7f57b2ffd700 1 -- 172.21.15.37:0/1152588176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00bd60 con 0x7f57b40b0710 2023-10-06T04:18:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 -- 172.21.15.37:0/1152588176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b40b0710 msgr2=0x7f57b415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b40b0710 0x7f57b415be70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f579c0099b0 tx=0x7f579c009250 comp rx=0 tx=0).stop 2023-10-06T04:18:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 -- 172.21.15.37:0/1152588176 shutdown_connections 2023-10-06T04:18:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b41578d0 0x7f57b406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 --2- 172.21.15.37:0/1152588176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b40b0710 0x7f57b415be70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 -- 172.21.15.37:0/1152588176 >> 172.21.15.37:0/1152588176 conn(0x7f57b40ce680 msgr2=0x7f57b40cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 -- 172.21.15.37:0/1152588176 shutdown_connections 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.742+0000 7f57ba81b700 1 -- 172.21.15.37:0/1152588176 wait complete. 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.743+0000 7f57ba81b700 1 Processor -- start 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.743+0000 7f57ba81b700 1 -- start start 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 0x7f57b40c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4157500 0x7f57b4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41541b0 con 0x7f57b41578d0 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40c2f40 con 0x7f57b4157500 2023-10-06T04:18:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57ba81b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40c2ab0 con 0x7f57b40b0710 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58966/0 (socket says 172.21.15.37:58966) 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 -- 172.21.15.37:0/158438578 learned_addr learned my addr 172.21.15.37:0/158438578 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b37fe700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4157500 0x7f57b4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b3fff700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 0x7f57b40c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 -- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 msgr2=0x7f57b40c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 0x7f57b40c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 -- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4157500 msgr2=0x7f57b4153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4157500 0x7f57b4153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:10.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 -- 172.21.15.37:0/158438578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0094f0 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b3fff700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 0x7f57b40c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57b8db8700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d1b0 tx=0x7f57ac009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00dda0 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00f040 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.744+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac015690 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.745+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40c4660 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.745+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40c2460 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.746+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40c2c60 con 0x7f57b41578d0 2023-10-06T04:18:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.746+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57ac01e3b0 con 0x7f57b41578d0 2023-10-06T04:18:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.746+0000 7f57abfff700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:18:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.747+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57ac084c60 con 0x7f57b41578d0 2023-10-06T04:18:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.747+0000 7f57b3fff700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:18:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.747+0000 7f57b3fff700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 0x7f57940693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57a4001820 tx=0x7f57a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:18:10.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:10.751+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57b40c2c60 con 0x7f57b41578d0 2023-10-06T04:18:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.022+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f57b40c2c60 con 0x7f57b41578d0 2023-10-06T04:18:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.023+0000 7f57abfff700 1 -- 172.21.15.37:0/158438578 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f57b40c2c60 con 0x7f57b41578d0 2023-10-06T04:18:11.024 INFO:teuthology.orchestra.run.smithi037.stdout:[client.admin] 2023-10-06T04:18:11.024 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD8iR9l2TRaBhAA95D/i6oF0aU/ITjFD7zSmw== 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 msgr2=0x7f57940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 0x7f57940693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57a4001820 tx=0x7f57a4009040 comp rx=0 tx=0).stop 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 msgr2=0x7f57b40c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d1b0 tx=0x7f57ac009a50 comp rx=0 tx=0).stop 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 shutdown_connections 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b41578d0 0x7f57b40c4120 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57b40b0710 0x7f57b40c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 --2- 172.21.15.37:0/158438578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57b4157500 0x7f57b4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:18:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 >> 172.21.15.37:0/158438578 conn(0x7f57b40ce680 msgr2=0x7f57b41548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:18:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 shutdown_connections 2023-10-06T04:18:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:18:11.025+0000 7f57ba81b700 1 -- 172.21.15.37:0/158438578 wait complete. 2023-10-06T04:18:11.038 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T04:18:11.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/tmp/tmp.9DYHaiFvvixfstests-dev/local.config 2023-10-06T04:18:11.064 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.9DYHaiFvvixfstests-dev && exec sudo make) 2023-10-06T04:18:11.170 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize -cfi 2023-10-06T04:18:11.567 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-06T04:18:11.568 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.guess' 2023-10-06T04:18:11.571 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.sub' 2023-10-06T04:18:11.574 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './install-sh' 2023-10-06T04:18:11.578 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './ltmain.sh' 2023-10-06T04:18:11.599 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-06T04:18:11.599 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-06T04:18:11.604 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-06T04:18:11.608 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-06T04:18:11.612 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-06T04:18:11.617 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-06T04:18:11.624 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-06T04:18:11.624 INFO:teuthology.orchestra.run.smithi037.stdout:cp include/install-sh . 2023-10-06T04:18:11.625 INFO:teuthology.orchestra.run.smithi037.stdout:aclocal -I m4 2023-10-06T04:18:12.795 INFO:teuthology.orchestra.run.smithi037.stdout:autoheader 2023-10-06T04:18:13.117 INFO:teuthology.orchestra.run.smithi037.stdout:autoconf 2023-10-06T04:18:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:./configure \ 2023-10-06T04:18:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: --libexecdir=/usr/lib \ 2023-10-06T04:18:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: --exec_prefix=/var/lib 2023-10-06T04:18:13.717 INFO:teuthology.orchestra.run.smithi037.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-06T04:18:13.717 INFO:teuthology.orchestra.run.smithi037.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-06T04:18:13.718 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to print strings... printf 2023-10-06T04:18:13.719 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... gcc 2023-10-06T04:18:13.852 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the C compiler works... yes 2023-10-06T04:18:13.852 INFO:teuthology.orchestra.run.smithi037.stdout:checking for C compiler default output file name... a.out 2023-10-06T04:18:13.882 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of executables... 2023-10-06T04:18:13.944 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are cross compiling... no 2023-10-06T04:18:13.962 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of object files... o 2023-10-06T04:18:13.978 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... yes 2023-10-06T04:18:13.995 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... yes 2023-10-06T04:18:14.022 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-06T04:18:14.024 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-06T04:18:14.027 INFO:teuthology.orchestra.run.smithi037.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-06T04:18:14.028 INFO:teuthology.orchestra.run.smithi037.stdout:checking for egrep... /bin/grep -E 2023-10-06T04:18:14.029 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fgrep... /bin/grep -F 2023-10-06T04:18:14.033 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ld used by gcc... /bin/ld 2023-10-06T04:18:14.034 INFO:teuthology.orchestra.run.smithi037.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-06T04:18:14.041 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-06T04:18:14.058 INFO:teuthology.orchestra.run.smithi037.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-06T04:18:14.058 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-10-06T04:18:14.065 INFO:teuthology.orchestra.run.smithi037.stdout:checking the maximum length of command line arguments... 1572864 2023-10-06T04:18:14.069 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-06T04:18:14.069 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-06T04:18:14.069 INFO:teuthology.orchestra.run.smithi037.stdout:checking for /bin/ld option to reload object files... -r 2023-10-06T04:18:14.069 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdump... objdump 2023-10-06T04:18:14.069 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to recognize dependent libraries... pass_all 2023-10-06T04:18:14.070 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlltool... no 2023-10-06T04:18:14.071 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-06T04:18:14.071 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ar... ar 2023-10-06T04:18:14.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking for archiver @FILE support... @ 2023-10-06T04:18:14.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strip... strip 2023-10-06T04:18:14.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ranlib... ranlib 2023-10-06T04:18:14.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gawk... gawk 2023-10-06T04:18:14.146 INFO:teuthology.orchestra.run.smithi037.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-06T04:18:14.147 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sysroot... no 2023-10-06T04:18:14.150 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a working dd... /bin/dd 2023-10-06T04:18:14.152 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-06T04:18:14.166 INFO:teuthology.orchestra.run.smithi037.stdout:checking for mt... no 2023-10-06T04:18:14.167 INFO:teuthology.orchestra.run.smithi037.stdout:checking if : is a manifest tool... no 2023-10-06T04:18:14.221 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to run the C preprocessor... gcc -E 2023-10-06T04:18:14.356 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ANSI C header files... yes 2023-10-06T04:18:14.377 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... yes 2023-10-06T04:18:14.402 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... yes 2023-10-06T04:18:14.426 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdlib.h... yes 2023-10-06T04:18:14.450 INFO:teuthology.orchestra.run.smithi037.stdout:checking for string.h... yes 2023-10-06T04:18:14.475 INFO:teuthology.orchestra.run.smithi037.stdout:checking for memory.h... yes 2023-10-06T04:18:14.500 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... yes 2023-10-06T04:18:14.534 INFO:teuthology.orchestra.run.smithi037.stdout:checking for inttypes.h... yes 2023-10-06T04:18:14.560 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdint.h... yes 2023-10-06T04:18:14.588 INFO:teuthology.orchestra.run.smithi037.stdout:checking for unistd.h... yes 2023-10-06T04:18:14.651 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlfcn.h... yes 2023-10-06T04:18:14.654 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdir... .libs 2023-10-06T04:18:14.722 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-06T04:18:14.722 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-06T04:18:14.737 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-06T04:18:14.758 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc static flag -static works... no 2023-10-06T04:18:14.778 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... yes 2023-10-06T04:18:14.778 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-06T04:18:14.784 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-06T04:18:14.813 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether -lc should be explicitly linked in... no 2023-10-06T04:18:14.872 INFO:teuthology.orchestra.run.smithi037.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-06T04:18:14.872 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to hardcode library paths into programs... immediate 2023-10-06T04:18:14.873 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether stripping libraries is possible... yes 2023-10-06T04:18:14.873 INFO:teuthology.orchestra.run.smithi037.stdout:checking if libtool supports shared libraries... yes 2023-10-06T04:18:14.873 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build shared libraries... yes 2023-10-06T04:18:14.873 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build static libraries... yes 2023-10-06T04:18:14.877 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... (cached) gcc 2023-10-06T04:18:14.894 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-06T04:18:14.894 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-06T04:18:14.894 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-06T04:18:14.894 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gmake... /usr/bin/gmake 2023-10-06T04:18:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-10-06T04:18:14.896 INFO:teuthology.orchestra.run.smithi037.stdout:checking for tar... /bin/tar 2023-10-06T04:18:14.896 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gzip... /bin/gzip 2023-10-06T04:18:14.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc -MM is supported... yes 2023-10-06T04:18:14.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sort... /bin/sort 2023-10-06T04:18:14.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-10-06T04:18:14.903 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpm... /bin/rpm 2023-10-06T04:18:14.906 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpmbuild... no 2023-10-06T04:18:14.944 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h usability... yes 2023-10-06T04:18:14.950 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h presence... yes 2023-10-06T04:18:14.951 INFO:teuthology.orchestra.run.smithi037.stdout:checking for assert.h... yes 2023-10-06T04:18:14.978 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h usability... no 2023-10-06T04:18:14.987 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h presence... no 2023-10-06T04:18:14.987 INFO:teuthology.orchestra.run.smithi037.stdout:checking for bstring.h... no 2023-10-06T04:18:15.011 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h usability... yes 2023-10-06T04:18:15.018 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h presence... yes 2023-10-06T04:18:15.018 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libgen.h... yes 2023-10-06T04:18:15.047 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h usability... yes 2023-10-06T04:18:15.054 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h presence... yes 2023-10-06T04:18:15.054 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dirent.h... yes 2023-10-06T04:18:15.116 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h usability... yes 2023-10-06T04:18:15.123 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h presence... yes 2023-10-06T04:18:15.123 INFO:teuthology.orchestra.run.smithi037.stdout:checking for errno.h... yes 2023-10-06T04:18:15.151 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h usability... yes 2023-10-06T04:18:15.160 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h presence... yes 2023-10-06T04:18:15.160 INFO:teuthology.orchestra.run.smithi037.stdout:checking for malloc.h... yes 2023-10-06T04:18:15.186 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h usability... no 2023-10-06T04:18:15.196 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h presence... no 2023-10-06T04:18:15.196 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid.h... no 2023-10-06T04:18:15.224 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h usability... yes 2023-10-06T04:18:15.232 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h presence... yes 2023-10-06T04:18:15.232 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid/uuid.h... yes 2023-10-06T04:18:15.258 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h usability... no 2023-10-06T04:18:15.268 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h presence... no 2023-10-06T04:18:15.268 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/uuid.h... no 2023-10-06T04:18:15.305 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h usability... yes 2023-10-06T04:18:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h presence... yes 2023-10-06T04:18:15.313 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/file.h... yes 2023-10-06T04:18:15.342 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h usability... yes 2023-10-06T04:18:15.349 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h presence... yes 2023-10-06T04:18:15.349 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fcntl.h... yes 2023-10-06T04:18:15.375 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h usability... no 2023-10-06T04:18:15.385 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h presence... no 2023-10-06T04:18:15.385 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/syssgi.h... no 2023-10-06T04:18:15.424 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h usability... yes 2023-10-06T04:18:15.434 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h presence... yes 2023-10-06T04:18:15.434 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/param.h... yes 2023-10-06T04:18:15.439 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... (cached) yes 2023-10-06T04:18:15.467 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h usability... yes 2023-10-06T04:18:15.474 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h presence... yes 2023-10-06T04:18:15.474 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/statvfs.h... yes 2023-10-06T04:18:15.501 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h usability... yes 2023-10-06T04:18:15.509 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h presence... yes 2023-10-06T04:18:15.509 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/time.h... yes 2023-10-06T04:18:15.539 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h usability... yes 2023-10-06T04:18:15.546 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h presence... yes 2023-10-06T04:18:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/ioctl.h... yes 2023-10-06T04:18:15.578 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h usability... yes 2023-10-06T04:18:15.587 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h presence... yes 2023-10-06T04:18:15.587 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/wait.h... yes 2023-10-06T04:18:15.592 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... (cached) yes 2023-10-06T04:18:15.597 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... (cached) yes 2023-10-06T04:18:15.627 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h usability... yes 2023-10-06T04:18:15.634 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h presence... yes 2023-10-06T04:18:15.634 INFO:teuthology.orchestra.run.smithi037.stdout:checking for err.h... yes 2023-10-06T04:18:15.661 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h usability... yes 2023-10-06T04:18:15.668 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h presence... yes 2023-10-06T04:18:15.668 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/falloc.h... yes 2023-10-06T04:18:15.694 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-06T04:18:15.704 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-06T04:18:15.704 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-06T04:18:15.727 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-06T04:18:15.737 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-06T04:18:15.737 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-06T04:18:15.761 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h usability... no 2023-10-06T04:18:15.770 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h presence... no 2023-10-06T04:18:15.770 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/platform_defs.h... no 2023-10-06T04:18:15.794 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h usability... no 2023-10-06T04:18:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h presence... no 2023-10-06T04:18:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfs/ioctl.h... no 2023-10-06T04:18:15.827 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h usability... no 2023-10-06T04:18:15.836 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h presence... no 2023-10-06T04:18:15.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking for cifs/ioctl.h... no 2023-10-06T04:18:15.869 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h usability... yes 2023-10-06T04:18:15.876 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h presence... yes 2023-10-06T04:18:15.876 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/mman.h... yes 2023-10-06T04:18:15.893 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs_log_format.h... no 2023-10-06T04:18:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare... no 2023-10-06T04:18:15.957 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare in -luuid... yes 2023-10-06T04:18:16.012 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs.h... yes 2023-10-06T04:18:16.026 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/libxfs.h... no 2023-10-06T04:18:16.042 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-06T04:18:16.070 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xqm.h... yes 2023-10-06T04:18:16.115 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-06T04:18:16.138 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h usability... yes 2023-10-06T04:18:16.145 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h presence... yes 2023-10-06T04:18:16.145 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/handle.h... yes 2023-10-06T04:18:16.181 INFO:teuthology.orchestra.run.smithi037.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-06T04:18:16.205 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h usability... yes 2023-10-06T04:18:16.213 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h presence... yes 2023-10-06T04:18:16.213 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/acl.h... yes 2023-10-06T04:18:16.249 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h usability... yes 2023-10-06T04:18:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h presence... yes 2023-10-06T04:18:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl/libacl.h... yes 2023-10-06T04:18:16.289 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl_init in -lacl... yes 2023-10-06T04:18:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h usability... no 2023-10-06T04:18:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h presence... no 2023-10-06T04:18:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm-ndbm.h... no 2023-10-06T04:18:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h usability... no 2023-10-06T04:18:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h presence... no 2023-10-06T04:18:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm/ndbm.h... no 2023-10-06T04:18:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:checking ndbm.h usability... no 2023-10-06T04:18:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:checking ndbm.h presence... no 2023-10-06T04:18:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ndbm.h... no 2023-10-06T04:18:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h usability... yes 2023-10-06T04:18:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h presence... yes 2023-10-06T04:18:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libaio.h... yes 2023-10-06T04:18:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h usability... no 2023-10-06T04:18:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h presence... no 2023-10-06T04:18:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking for liburing.h... no 2023-10-06T04:18:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h usability... no 2023-10-06T04:18:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h presence... no 2023-10-06T04:18:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/capability.h... no 2023-10-06T04:18:16.506 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h usability... yes 2023-10-06T04:18:16.513 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h presence... yes 2023-10-06T04:18:16.513 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fiemap.h... yes 2023-10-06T04:18:16.546 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fallocate... yes 2023-10-06T04:18:16.579 INFO:teuthology.orchestra.run.smithi037.stdout:checking for open_by_handle_at... yes 2023-10-06T04:18:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h usability... yes 2023-10-06T04:18:16.611 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h presence... yes 2023-10-06T04:18:16.612 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/prctl.h... yes 2023-10-06T04:18:16.635 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h usability... yes 2023-10-06T04:18:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h presence... yes 2023-10-06T04:18:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fs.h... yes 2023-10-06T04:18:16.664 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h usability... no 2023-10-06T04:18:16.674 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h presence... no 2023-10-06T04:18:16.674 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfsutil.h... no 2023-10-06T04:18:16.710 INFO:teuthology.orchestra.run.smithi037.stdout:checking for copy_file_range... yes 2023-10-06T04:18:16.745 INFO:teuthology.orchestra.run.smithi037.stdout:checking for SEEK_DATA... yes 2023-10-06T04:18:16.792 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BMV_OF_SHARED... yes 2023-10-06T04:18:16.833 INFO:teuthology.orchestra.run.smithi037.stdout:checking for nftw... yes 2023-10-06T04:18:16.867 INFO:teuthology.orchestra.run.smithi037.stdout:checking for RLIMIT_NOFILE... yes 2023-10-06T04:18:16.886 INFO:teuthology.orchestra.run.smithi037.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-06T04:18:16.917 INFO:teuthology.orchestra.run.smithi037.stdout:checking for renameat2... yes 2023-10-06T04:18:16.950 INFO:teuthology.orchestra.run.smithi037.stdout:checking for reallocarray... yes 2023-10-06T04:18:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct mount_attr... no 2023-10-06T04:18:17.010 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-06T04:18:17.044 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-06T04:18:17.078 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-06T04:18:17.113 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-06T04:18:17.147 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-06T04:18:17.182 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-06T04:18:17.216 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-06T04:18:17.243 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h usability... yes 2023-10-06T04:18:17.250 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h presence... yes 2023-10-06T04:18:17.250 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs.h... yes 2023-10-06T04:18:17.280 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-06T04:18:17.288 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-06T04:18:17.288 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs_tree.h... yes 2023-10-06T04:18:17.319 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-06T04:18:17.335 INFO:teuthology.orchestra.run.smithi037.stdout:configure: creating ./config.status 2023-10-06T04:18:17.636 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/builddefs 2023-10-06T04:18:17.646 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/config.h 2023-10-06T04:18:17.654 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: executing libtool commands 2023-10-06T04:18:17.692 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-10-06T04:18:17.695 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-10-06T04:18:17.698 INFO:teuthology.orchestra.run.smithi037.stdout: [LTDEP] 2023-10-06T04:18:17.804 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dataascii.lo 2023-10-06T04:18:17.918 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] databin.lo 2023-10-06T04:18:18.061 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] datapid.lo 2023-10-06T04:18:18.161 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] file_lock.lo 2023-10-06T04:18:18.303 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] forker.lo 2023-10-06T04:18:18.432 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pattern.lo 2023-10-06T04:18:18.549 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_flags.lo 2023-10-06T04:18:18.685 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random_range.lo 2023-10-06T04:18:18.902 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] string_to_tokens.lo 2023-10-06T04:18:19.003 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] str_to_bytes.lo 2023-10-06T04:18:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] tlibio.lo 2023-10-06T04:18:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] write_log.lo 2023-10-06T04:18:19.576 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random.lo 2023-10-06T04:18:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: [LD] 2023-10-06T04:18:19.761 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-10-06T04:18:19.764 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:19.890 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] doio 2023-10-06T04:18:20.506 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsstress 2023-10-06T04:18:21.739 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsx 2023-10-06T04:18:22.557 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] growfiles 2023-10-06T04:18:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] iogen 2023-10-06T04:18:23.371 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-stress 2023-10-06T04:18:23.769 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-10-06T04:18:23.774 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:24.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:18:24.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:18:25.331 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:25.357 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:25.365 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:25.554 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-10-06T04:18:25.575 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirstress 2023-10-06T04:18:25.809 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill 2023-10-06T04:18:25.955 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill2 2023-10-06T04:18:26.169 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getpagesize 2023-10-06T04:18:26.298 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holes 2023-10-06T04:18:26.482 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] lstat64 2023-10-06T04:18:26.653 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nametest 2023-10-06T04:18:26.877 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] permname 2023-10-06T04:18:27.063 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] randholes 2023-10-06T04:18:27.297 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] runas 2023-10-06T04:18:27.462 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] truncfile 2023-10-06T04:18:27.631 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] usemem 2023-10-06T04:18:27.774 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmapcat 2023-10-06T04:18:27.915 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_reader 2023-10-06T04:18:28.058 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_writer 2023-10-06T04:18:28.201 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirperf 2023-10-06T04:18:28.406 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] metaperf 2023-10-06T04:18:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] devzero 2023-10-06T04:18:28.809 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] feature 2023-10-06T04:18:29.010 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] alloc 2023-10-06T04:18:29.207 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fault 2023-10-06T04:18:29.361 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fstest 2023-10-06T04:18:29.582 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_access_root 2023-10-06T04:18:29.729 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] godown 2023-10-06T04:18:29.887 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] resvtest 2023-10-06T04:18:30.061 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writemod 2023-10-06T04:18:30.197 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writev_on_pagefault 2023-10-06T04:18:30.347 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] makeextents 2023-10-06T04:18:30.513 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] itrash 2023-10-06T04:18:30.660 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] rename 2023-10-06T04:18:30.792 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] multi_open_unlink 2023-10-06T04:18:30.948 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_sync 2023-10-06T04:18:31.117 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] genhashnames 2023-10-06T04:18:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_holes 2023-10-06T04:18:31.445 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev 2023-10-06T04:18:31.586 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_cmtime 2023-10-06T04:18:31.736 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirhash_collide 2023-10-06T04:18:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_rename_overwrite 2023-10-06T04:18:32.042 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holetest 2023-10-06T04:18:32.248 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_self 2023-10-06T04:18:32.382 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] af_unix 2023-10-06T04:18:32.526 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_stale_pmd 2023-10-06T04:18:32.671 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_race 2023-10-06T04:18:32.826 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_fallocate 2023-10-06T04:18:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-err 2023-10-06T04:18:33.144 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_write_ro 2023-10-06T04:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-06T04:18:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-06T04:18:33.585 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ofd_locks 2023-10-06T04:18:33.771 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_collision 2023-10-06T04:18:33.958 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-write-concurrent 2023-10-06T04:18:34.118 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_get_file_time 2023-10-06T04:18:34.258 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_short_dirs 2023-10-06T04:18:34.417 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_long_dirs 2023-10-06T04:18:34.572 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_enospc 2023-10-06T04:18:34.748 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev_overlap 2023-10-06T04:18:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] checkpoint_journal 2023-10-06T04:18:35.054 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-rw-fault 2023-10-06T04:18:35.229 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] allocstale 2023-10-06T04:18:35.388 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_memory_failure 2023-10-06T04:18:35.551 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fake-dump-rootino 2023-10-06T04:18:35.693 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-buf-fault 2023-10-06T04:18:35.839 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsctl 2023-10-06T04:18:36.017 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bstat 2023-10-06T04:18:36.210 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mtab 2023-10-06T04:18:36.384 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getdevicesize 2023-10-06T04:18:36.520 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_reader 2023-10-06T04:18:36.669 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_writer 2023-10-06T04:18:36.823 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ftrunc 2023-10-06T04:18:36.965 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] trunc 2023-10-06T04:18:37.119 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fs_perms 2023-10-06T04:18:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] testx 2023-10-06T04:18:37.400 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] looptest 2023-10-06T04:18:37.583 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] locktest 2023-10-06T04:18:37.872 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_mmap 2023-10-06T04:18:38.025 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test 2023-10-06T04:18:38.214 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] deduperace 2023-10-06T04:18:38.397 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test_modified 2023-10-06T04:18:38.584 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset 2023-10-06T04:18:38.724 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_futimens 2023-10-06T04:18:38.860 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_immutable 2023-10-06T04:18:39.427 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stale_handle 2023-10-06T04:18:39.588 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pwrite_mmap_blocked 2023-10-06T04:18:39.734 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset2 2023-10-06T04:18:39.915 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_sanity_test 2023-10-06T04:18:40.310 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_copy_test 2023-10-06T04:18:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_1 2023-10-06T04:18:40.615 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_2 2023-10-06T04:18:40.760 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-tester 2023-10-06T04:18:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nsexec 2023-10-06T04:18:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] cloner 2023-10-06T04:18:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] renameat2 2023-10-06T04:18:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_getcwd 2023-10-06T04:18:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] e4compact 2023-10-06T04:18:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] test-nextquota 2023-10-06T04:18:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] punch-alternating 2023-10-06T04:18:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-06T04:18:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] listxattr 2023-10-06T04:18:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-interleaved 2023-10-06T04:18:42.645 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_type 2023-10-06T04:18:42.793 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-invalidate-cache 2023-10-06T04:18:42.985 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stat_test 2023-10-06T04:18:43.264 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_encrypted_d_revalidate 2023-10-06T04:18:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr_replace_test 2023-10-06T04:18:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] swapon 2023-10-06T04:18:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mkswap 2023-10-06T04:18:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_attr_corruption 2023-10-06T04:18:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_open_tmpfiles 2023-10-06T04:18:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fscrypt-crypt-util 2023-10-06T04:18:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_null_ocount 2023-10-06T04:18:44.938 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice-test 2023-10-06T04:18:45.109 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] chprojid_fail 2023-10-06T04:18:45.264 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] detached_mounts_propagation 2023-10-06T04:18:45.437 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ext4_resize 2023-10-06T04:18:45.578 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_3 2023-10-06T04:18:45.761 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice2pipe 2023-10-06T04:18:45.917 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] uuid_ioctl 2023-10-06T04:18:46.063 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fiemap-tester 2023-10-06T04:18:46.314 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_stripealign 2023-10-06T04:18:46.461 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_by_handle 2023-10-06T04:18:46.701 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_dio 2023-10-06T04:18:46.854 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsfind 2023-10-06T04:18:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fssum 2023-10-06T04:18:47.436 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-10-06T04:18:47.441 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] replay-log 2023-10-06T04:18:47.733 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-10-06T04:18:47.736 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-10-06T04:18:47.742 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-06T04:18:47.908 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-fcntl-race 2023-10-06T04:18:48.065 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-subblock-eof-read 2023-10-06T04:18:48.206 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-read-race 2023-10-06T04:18:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-readahead 2023-10-06T04:18:48.532 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-hole-filling-race 2023-10-06T04:18:48.678 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-06T04:18:48.813 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-last-ref-held-by-io 2023-10-06T04:18:48.979 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cycle-write 2023-10-06T04:18:49.158 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-extend-stat 2023-10-06T04:18:49.318 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-06T04:18:49.448 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiocp 2023-10-06T04:18:49.663 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-failure 2023-10-06T04:18:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiodio_sparse2 2023-10-06T04:18:50.024 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cow-race 2023-10-06T04:18:50.174 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-write-verify 2023-10-06T04:18:50.362 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-eof-race 2023-10-06T04:18:50.539 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-10-06T04:18:50.544 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] vfstest 2023-10-06T04:18:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mount-idmapped 2023-10-06T04:18:52.658 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-10-06T04:18:52.662 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-10-06T04:18:52.665 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-10-06T04:18:52.670 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-10-06T04:18:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/perf/group.list 2023-10-06T04:18:52.685 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-10-06T04:18:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ext4/group.list 2023-10-06T04:18:52.725 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-10-06T04:18:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ocfs2/group.list 2023-10-06T04:18:52.742 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-10-06T04:18:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/overlay/group.list 2023-10-06T04:18:52.782 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-10-06T04:18:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/cifs/group.list 2023-10-06T04:18:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-10-06T04:18:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/generic/group.list 2023-10-06T04:18:52.898 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-10-06T04:18:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/shared/group.list 2023-10-06T04:18:52.918 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-10-06T04:18:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/xfs/group.list 2023-10-06T04:18:53.018 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-10-06T04:18:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/f2fs/group.list 2023-10-06T04:18:53.039 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-10-06T04:18:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/udf/group.list 2023-10-06T04:18:53.054 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-10-06T04:18:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ceph/group.list 2023-10-06T04:18:53.072 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-10-06T04:18:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/nfs/group.list 2023-10-06T04:18:53.090 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-10-06T04:18:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/btrfs/group.list 2023-10-06T04:18:53.150 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-10-06T04:18:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/tmpfs/group.list 2023-10-06T04:18:53.167 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-10-06T04:18:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/selftest/group.list 2023-10-06T04:18:53.186 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.9DYHaiFvvixfstests-dev && exec sudo make install) 2023-10-06T04:18:53.221 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-10-06T04:18:53.224 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-10-06T04:18:53.228 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-10-06T04:18:53.232 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-10-06T04:18:53.266 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-10-06T04:18:53.269 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-10-06T04:18:53.272 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-10-06T04:18:53.278 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-10-06T04:18:53.279 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-10-06T04:18:53.283 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-10-06T04:18:53.286 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-10-06T04:18:53.291 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-10-06T04:18:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/perf/group.list 2023-10-06T04:18:53.307 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-10-06T04:18:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ext4/group.list 2023-10-06T04:18:53.346 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-10-06T04:18:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ocfs2/group.list 2023-10-06T04:18:53.362 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-10-06T04:18:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/overlay/group.list 2023-10-06T04:18:53.403 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-10-06T04:18:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/cifs/group.list 2023-10-06T04:18:53.419 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-10-06T04:18:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/generic/group.list 2023-10-06T04:18:53.517 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-10-06T04:18:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/shared/group.list 2023-10-06T04:18:53.537 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-10-06T04:18:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/xfs/group.list 2023-10-06T04:18:53.634 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-10-06T04:18:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/f2fs/group.list 2023-10-06T04:18:53.655 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-10-06T04:18:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/udf/group.list 2023-10-06T04:18:53.670 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-10-06T04:18:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ceph/group.list 2023-10-06T04:18:53.688 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-10-06T04:18:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/nfs/group.list 2023-10-06T04:18:53.706 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-10-06T04:18:53.711 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/btrfs/group.list 2023-10-06T04:18:53.766 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-10-06T04:18:53.771 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/tmpfs/group.list 2023-10-06T04:18:53.783 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-10-06T04:18:53.788 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.9DYHaiFvvixfstests-dev/tests/selftest/group.list 2023-10-06T04:18:53.799 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-06T04:18:53.801 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:18:53.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-06T04:18:53.803 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:18:53.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-06T04:18:53.805 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-06T04:18:53.814 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-06T04:18:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-06T04:18:53.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-06T04:18:53.917 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-10-06T04:18:53.921 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-10-06T04:18:53.924 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-10-06T04:18:53.928 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-10-06T04:18:53.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C log-writes install 2023-10-06T04:18:53.932 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-06T04:18:53.941 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-06T04:18:53.950 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C perf install 2023-10-06T04:18:53.951 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-06T04:18:53.960 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-06T04:18:53.982 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-06T04:18:53.984 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-06T04:18:53.992 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-06T04:18:54.046 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C vfs install 2023-10-06T04:18:54.047 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-06T04:18:54.056 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-06T04:18:54.068 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-06T04:18:54.076 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-06T04:18:54.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:18:54.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-06T04:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-06T04:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-06T04:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-06T04:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-06T04:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-06T04:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-06T04:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/btrfs/ install 2023-10-06T04:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-06T04:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-06T04:18:56.405 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-06T04:18:56.414 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 140.out 056.out 236.out 202.out 008.out 040.out 004.out 047.out 199.out 233.out 055.out 095.out 009.out 033.out 082.out 270.out 088.out 036.out 296.out 225.out 210.out 002.out 125.out 037.out 181.out 152.out 103.out 024.out 243.out 192.out 148.out 282.out 077.out 052.out 256.out 228.out 128.out 028.out 273.out 114.out 274.out 251.out 267.out 043.out 069.out 065.out 209.out 207.out 151.out 195.out 106.out 215.out 115.out 015.out 227.out 250.out 191.out 046.out 051.out 101.out 219.out 119.out 244.out 232.out 143.out 188.out 220.out 120.out 020.out 102.out 171.out 261.out 156.out 217.out 072.out 048.out 062.out 038.out 073.out 129.out 066.out 029.out 229.out 003.out 111.out 011.out 234.out 275.out 134.out 170.out 260.out 034.out 133.out 286.out 161.out 175.out 216.out 116.out 016.out 118.out 110.out 010.out 238.out 281.out 276.out 295.out 138.out 014.out 277.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 239.out 085.out 265.out 300.out 200.out 100.out 258.out 269.out 208.out 039.out 222.out 169.out 098.out 090.out 080.out 070.out 060.out 206.out 109.out 006.out 167.out 117.out 017.out 246.out 158.out 182.out 204.out 104.out 177.out 254.out 279.out 241.out 235.out 268.out 224.out 025.out 124.out 142.out 172.out 278.out 058.out 262.out 042.out 253.out 297.out 193.out 097.out 271.out 283.out 083.out 135.out 045.out 086.out 053.out 157.out 164.out 257.out 094.out 189.out 139.out 089.out 178.out 001.out 165.out 141.out 214.out 074.out 176.out 012.out 041.out 155.out 064.out 186.out 240.out 252.out 280.out 005.out 223.out 150.out 132.out 179.out 144.out 032.out 057.out 205.out 136.out 146.out 174.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 263.out 027.out 291.out 187.out 084.out 266.out 153.out 285.out 183.out 123.out 044.out 201.out 019.out 287.out 237.out 067.out 231.out 075.out 163.out 131.out 213.out 113.out 031.out 272.out 078.out 184.out 259.out 293.out 197.out 127.out 230.out 076.out 292.out 130.out 023.out 099.out 092.out 030.out 203.out 063.out 194.out 159.out 249.out 122.out 166.out 022.out 289.out 284.out 255.out 290.out 299.out 154.out 149.out 068.out 185.out 264.out 218.out 018.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out 121.out 026.out 180.out 013.out 035.out 221.out 087.out 294.out 212.out 112.out 245.out 021.out 247.out 211.out 107.out 248.out 162.out 147.out 288.out 196.out 242.out /var/lib/xfstests/tests/btrfs 2023-10-06T04:18:57.240 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ceph/ install 2023-10-06T04:18:57.241 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-06T04:18:57.250 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-06T04:18:57.269 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-06T04:18:57.278 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-06T04:18:57.298 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/cifs/ install 2023-10-06T04:18:57.299 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-06T04:18:57.308 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-06T04:18:57.317 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-06T04:18:57.325 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-06T04:18:57.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ext4/ install 2023-10-06T04:18:57.336 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-06T04:18:57.345 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-06T04:18:57.535 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-06T04:18:57.544 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 305.out 005.out 008.out 023.out 056.out 308.out 050.out 040.out 307.out 006.out 035.out 021.out 017.out 012.out 009.out 033.out 301.out 019.out 026.out 047.out 303.out 302.out 020.out 002.out 044.out 013.out 031.out 025.out 304.out 003.out 048.out 038.out 052.out 042.out 037.out 029.out 011.out 028.out 055.out 030.out 058.out 034.out 015.out 043.out 053.out 036.out 016.out 027.out 010.out 306.out 022.out 014.out 004.out 057.out 045.out 046.out 271.out 051.out 041.out 024.out 018.out 007.out 054.out 059.out /var/lib/xfstests/tests/ext4 2023-10-06T04:18:57.743 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/f2fs/ install 2023-10-06T04:18:57.745 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-06T04:18:57.754 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-06T04:18:57.766 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-06T04:18:57.775 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-06T04:18:57.786 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/generic/ install 2023-10-06T04:18:57.790 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-06T04:18:57.799 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-06T04:18:59.812 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-06T04:18:59.821 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 035.cfg 050.cfg 377.out 537.out 234.out 295.out 033.out 385.out 248.out 696.out 149.out 502.out 088.out 366.out 202.out 137.out 102.out 343.out 110.out 468.out 181.out 571.out 531.out 567.out 192.out 726.out 282.out 472.out 628.out 284.out 528.out 607.out 428.out 659.out 128.out 183.out 389.out 271.out 620.out 273.out 265.out 420.out 087.out 089.out 406.out 195.out 346.out 007.out 466.out 632.out 532.out 591.out 064.out 719.out 111.out 723.out 255.out 011.out 623.out 371.out 319.out 467.out 523.out 119.out 423.out 323.out 155.out 134.out 686.out 638.out 174.out 716.out 161.out 516.out 538.out 316.out 216.out 438.out 041.out 358.out 338.out 287.out 238.out 138.out 474.out 097.out 160.out 647.out 691.out 061.out 258.out 588.out 379.out 039.out 046.out 310.out 098.out 426.out 690.out 573.out 706.out 060.out 506.out 306.out 206.out 106.out 006.out 167.out 217.out 191.out 133.out 117.out 411.out 017.out 542.out 211.out 158.out 177.out 724.out 279.out 524.out 424.out 156.out 324.out 082.out 224.out 313.out 124.out 024.out 278.out 058.out 384.out 447.out 042.out 497.out 487.out 047.out 193.out 526.out 399.out 473.out 135.out 709.out 609.out 365.out 509.out 409.out 309.out 209.out 441.out 157.out 356.out 257.out 341.out 678.out 094.out 337.out 241.out 077.out 714.out 616.out 614.out 514.out 414.out 314.out 440.out 114.out 014.out 342.out 671.out 116.out 667.out 340.out 649.out 572.out 568.out 586.out 240.out 549.out 267.out 633.out 434.out 140.out 708.out 533.out 185.out 508.out 408.out 308.out 433.out 670.out 404.out 104.out 004.out 416.out 141.out 176.out 118.out 640.out 483.out 565.out 297.out 393.out 560.out 333.out 599.out 683.out 199.out 227.out 233.out 245.out 639.out 443.out 540.out 086.out 539.out 711.out 164.out 636.out 339.out 652.out 694.out 617.out 498.out 489.out 139.out 178.out 390.out 552.out 695.out 576.out 357.out 677.out 415.out 175.out 593.out 067.out 452.out 679.out 548.out 015.out 606.out 376.out 352.out 663.out 002.out 394.out 651.out 495.out 188.out 482.out 625.out 283.out 252.out 488.out 148.out 673.out 040.out 325.out 551.out 225.out 096.out 125.out 186.out 222.out 693.out 650.out 152.out 630.out 563.out 674.out 451.out 436.out 392.out 075.out 595.out 578.out 530.out 550.out 052.out 062.out 351.out 276.out 475.out 450.out 517.out 463.out 330.out 069.out 644.out 688.out 350.out 544.out 715.out 395.out 515.out 315.out 344.out 215.out 115.out 597.out 205.out 250.out 681.out 594.out 536.out 577.out 244.out 637.out 336.out 579.out 236.out 405.out 182.out 136.out 598.out 144.out 036.out 198.out 108.out 008.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 367.out 291.out 437.out 266.out 619.out 189.out 685.out 363.out 562.out 382.out 570.out 388.out 527.out 044.out 689.out 432.out 237.out 190.out 163.out 556.out 413.out 332.out 661.out 664.out 320.out 521.out 582.out 372.out 478.out 612.out 584.out 462.out 173.out 037.out 251.out 492.out 051.out 099.out 660.out 063.out 561.out 668.out 465.out 648.out 362.out 387.out 194.out 721.out 289.out 574.out 477.out 123.out 370.out 519.out 290.out 299.out 581.out 076.out 461.out 646.out 107.out 263.out 658.out 626.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 021.out 485.out 347.out 675.out 702.out 361.out 564.out 294.out 066.out 247.out 585.out 162.out 083.out 147.out 288.out 197.out 396.out 446.out 354.out 355.out 575.out 360.out 431.out 543.out 270.out 261.out 045.out 692.out 634.out 272.out 729.out 378.out 458.out 534.out 151.out 429.out 662.out 503.out 329.out 587.out 303.out 129.out 131.out 368.out 486.out 223.out 132.out 669.out 023.out 459.out 032.out 277.out 146.out 398.out 728.out 296.out 590.out 280.out 484.out 491.out 455.out 016.out 656.out 731.out 374.out 583.out 285.out 631.out 328.out 260.out 501.out 171.out 027.out 101.out 687.out 722.out 331.out 504.out 179.out 231.out 613.out 513.out 213.out 730.out 095.out 013.out 031.out 364.out 645.out 596.out 727.out 078.out 510.out 627.out 184.out 430.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 643.out 493.out 419.out 127.out 699.out 071.out 445.out 292.out 130.out 219.out 073.out 703.out 603.out 403.out 030.out 203.out 103.out 003.out 025.out 386.out 349.out 055.out 456.out 469.out 622.out 122.out 026.out 522.out 422.out 624.out 322.out 254.out 159.out 249.out 381.out 448.out 166.out 022.out 642.out 684.out 490.out 654.out 435.out 439.out 353.out 375.out 600.out 154.out 566.out 500.out 618.out 518.out 418.out 318.out 264.out 218.out 018.out 232.out 172.out 168.out 034.out 293.out 079.out 054.out 059.out 049.out 348.out 239.out 442.out 228.out 657.out 621.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 494.out 412.out 312.out 212.out 112.out 256.out 012.out 028.out 682.out 554.out 070.out 373.out 720.out 481.out 243.out 196.out 520.out 242.out 457.out 655.out 120.out 019.out 220.out 629.out 602.out 153.out 402.out 302.out 020.out 529.out 717.out 460.out 417.out 317.out 142.out 092.out 672.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 262.out 611.out 511.out 029.out 311.out 676.out 187.out 170.out 053.out 065.out 286.out 713.out 043.out 496.out 056.out 545.out 559.out 710.out 610.out 274.out 410.out 701.out 601.out 401.out 301.out 201.out 010.out 001.out 214.out 281.out 048.out 665.out 589.out 113.out 074.out 697.out 145.out 641.out 464.out 091.out 081.out 653.out 700.out 400.out 300.out 200.out 100.out 359.out 541.out 269.out 546.out 698.out 553.out 298.out 169.out 090.out 080.out 707.out 608.out 507.out 407.out 307.out 208.out 109.out 009.out 391.out 230.out 150.out 557.out 453.out 666.out 246.out 725.out 383.out 085.out 704.out 604.out 635.out 334.out 525.out 558.out 304.out 204.out 535.out 425.out 345.out 335.out 207.out 718.out 444.out 235.out 470.out 268.out 253.out 165.out 275.out 615.out /var/lib/xfstests/tests/generic 2023-10-06T04:19:01.858 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/nfs/ install 2023-10-06T04:19:01.860 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-06T04:19:01.869 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-06T04:19:01.878 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-06T04:19:01.886 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-06T04:19:01.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/ocfs2/ install 2023-10-06T04:19:01.897 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-06T04:19:01.905 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-06T04:19:01.914 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-06T04:19:01.923 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-06T04:19:01.932 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/overlay/ install 2023-10-06T04:19:01.934 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-06T04:19:01.943 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-06T04:19:02.215 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-06T04:19:02.224 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 048.out 018.out 020.out 102.out 028.out 024.out 013.out 031.out 015.out 117.out 072.out 078.out 004.out 062.out 038.out 052.out 042.out 076.out 066.out 010.out 003.out 029.out 055.out 023.out 073.out 068.out 053.out 030.out 103.out 063.out 017.out 043.out 077.out 109.out 075.out 116.out 016.out 065.out 041.out 107.out 101.out 022.out 113.out 106.out 014.out 115.out 057.out 035.out 027.out 001.out 114.out 074.out 036.out 111.out 061.out 011.out 026.out 071.out 037.out 058.out 108.out 100.out 064.out 080.out 005.out 079.out 069.out 054.out 059.out 049.out 032.out 039.out 045.out 002.out 025.out 056.out 008.out 110.out 060.out 050.out 105.out 006.out 047.out 021.out 067.out 112.out 046.out 012.out 009.out 007.out 033.out 070.out 040.out 044.out 051.out 019.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-10-06T04:19:02.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/perf/ install 2023-10-06T04:19:02.500 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-06T04:19:02.509 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-06T04:19:02.518 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-06T04:19:02.527 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-06T04:19:02.536 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/selftest/ install 2023-10-06T04:19:02.537 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-06T04:19:02.546 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-06T04:19:02.568 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-06T04:19:02.576 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-06T04:19:02.599 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/shared/ install 2023-10-06T04:19:02.600 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-06T04:19:02.610 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-06T04:19:02.623 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-06T04:19:02.632 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-06T04:19:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/tmpfs/ install 2023-10-06T04:19:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-06T04:19:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-06T04:19:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-06T04:19:02.674 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-06T04:19:02.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/udf/ install 2023-10-06T04:19:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-06T04:19:02.693 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-06T04:19:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-06T04:19:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-06T04:19:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9DYHaiFvvixfstests-dev/tests/xfs/ install 2023-10-06T04:19:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-06T04:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-06T04:19:04.643 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-06T04:19:04.652 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 185.out 508.out 408.out 308.out 566.out 433.out 108.out 040.out 104.out 047.out 287.out 537.out 234.out 158.out 337.out 082.out 248.out 759.out 088.out 097.out 296.out 137.out 102.out 343.out 110.out 468.out 525.out 181.out 571.out 775.out 531.out 765.out 192.out 282.out 342.out 472.out 528.out 428.out 507.out 128.out 183.out 273.out 420.out 087.out 089.out 406.out 195.out 732.out 466.out 443.out 227.out 532.out 591.out 471.out 111.out 723.out 255.out 011.out 319.out 467.out 523.out 119.out 423.out 323.out 429.out 329.out 587.out 229.out 129.out 131.out 155.out 134.out 260.out 076.out 034.out 445.out 716.out 161.out 246.out 538.out 316.out 418.out 116.out 438.out 358.out 338.out 238.out 295.out 138.out 474.out 160.out 373.out 061.out 085.out 457.out 522.out 772.out 768.out 530.out 258.out 379.out 322.out 039.out 742.out 098.out 426.out 290.out 573.out 060.out 506.out 306.out 206.out 106.out 006.out 447.out 217.out 191.out 117.out 455.out 542.out 442.out 188.out 065.out 177.out 724.out 279.out 281.out 524.out 424.out 413.out 771.out 324.out 224.out 313.out 355.out 124.out 232.out 024.out 278.out 058.out 741.out 113.out 042.out 497.out 487.out 377.out 193.out 799.out 456.out 526.out 399.out 473.out 770.out 045.out 409.out 364.out 391.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 241.out 540.out 077.out 714.out 514.out 243.out 414.out 314.out 440.out 114.out 014.out 766.out 041.out 277.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 733.out 092.out 267.out 543.out 140.out 708.out 533.out 335.out 207.out 718.out 235.out 268.out 556.out 253.out 403.out 165.out 303.out 782.out 431.out 784.out 141.out 176.out 169.out 118.out 444.out 483.out 018.out 393.out 333.out 599.out 367.out 199.out 739.out 068.out 233.out 752.out 736.out 015.out 007.out 773.out 086.out 539.out 133.out 711.out 164.out 339.out 239.out 521.out 458.out 489.out 139.out 411.out 484.out 465.out 552.out 763.out 576.out 357.out 515.out 593.out 067.out 186.out 452.out 069.out 548.out 252.out 751.out 563.out 167.out 190.out 352.out 348.out 346.out 394.out 309.out 495.out 785.out 174.out 283.out 750.out 488.out 148.out 325.out 551.out 225.out 125.out 789.out 222.out 152.out 774.out 436.out 392.out 075.out 748.out 578.out 550.out 052.out 062.out 351.out 463.out 430.out 276.out 094.out 475.out 450.out 517.out 744.out 330.out 036.out 762.out 350.out 544.out 728.out 715.out 395.out 151.out 415.out 389.out 315.out 384.out 215.out 115.out 197.out 250.out 791.out 344.out 051.out 536.out 244.out 336.out 150.out 579.out 236.out 505.out 136.out 598.out 144.out 496.out 198.out 008.out 790.out 178.out 050.out 405.out 305.out 205.out 105.out 005.out 027.out 291.out 761.out 437.out 719.out 211.out 727.out 519.out 363.out 562.out 419.out 271.out 570.out 388.out 527.out 056.out 299.out 432.out 237.out 779.out 760.out 163.out 044.out 332.out 796.out 582.out 372.out 478.out 584.out 462.out 220.out 173.out 597.out 037.out 251.out 112.out 020.out 063.out 792.out 561.out 776.out 781.out 746.out 758.out 362.out 387.out 194.out 265.out 588.out 289.out 574.out 516.out 284.out 123.out 560.out 595.out 461.out 477.out 451.out 390.out 786.out 263.out 448.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 460.out 013.out 756.out 485.out 347.out 035.out 361.out 564.out 294.out 066.out 504.out 247.out 747.out 585.out 162.out 083.out 147.out 288.out 396.out 446.out 298.out 575.out 209.out 381.out 360.out 374.out 270.out 261.out 755.out 292.out 304.out 482.out 726.out 729.out 378.out 048.out 534.out 368.out 486.out 223.out 132.out 179.out 023.out 459.out 032.out 798.out 266.out 146.out 107.out 398.out 366.out 590.out 280.out 470.out 767.out 749.out 016.out 091.out 046.out 153.out 731.out 583.out 285.out 788.out 501.out 171.out 581.out 376.out 101.out 385.out 722.out 331.out 743.out 231.out 469.out 513.out 371.out 549.out 213.out 730.out 095.out 031.out 565.out 182.out 596.out 272.out 078.out 754.out 184.out 797.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 777.out 493.out 010.out 127.out 230.out 769.out 130.out 219.out 073.out 370.out 503.out 030.out 203.out 103.out 003.out 386.out 349.out 055.out 275.out 245.out 026.out 787.out 745.out 422.out 794.out 159.out 249.out 122.out 166.out 022.out 490.out 435.out 439.out 353.out 375.out 154.out 500.out 149.out 518.out 318.out 264.out 218.out 757.out 172.out 168.out 293.out 328.out 079.out 054.out 059.out 202.out 049.out 021.out 738.out 228.out 721.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 412.out 312.out 212.out 256.out 012.out 764.out 028.out 554.out 365.out 070.out 416.out 720.out 481.out 196.out 520.out 242.out 498.out 320.out 019.out 425.out 120.out 502.out 402.out 302.out 529.out 002.out 717.out 135.out 417.out 317.out 142.out 492.out 017.out 072.out 778.out 143.out 038.out 737.out 084.out 369.out 262.out 594.out 511.out 025.out 029.out 311.out 783.out 187.out 170.out 053.out 286.out 713.out 043.out 175.out 545.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 301.out 201.out 001.out 734.out 214.out 589.out 753.out 074.out 297.out 145.out 257.out 464.out 491.out 081.out 800.out 600.out 064.out 400.out 300.out 200.out 100.out 359.out 577.out 354.out 541.out 269.out 546.out 382.out 780.out 099.out 553.out 567.out 090.out 080.out 709.out 509.out 407.out 307.out 208.out 109.out 009.out 434.out 557.out 453.out 725.out 735.out 383.out 334.out 404.out 558.out 204.out 535.out 795.out 004.out 345.out 254.out /var/lib/xfstests/tests/xfs 2023-10-06T04:19:06.581 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-06T04:19:06.589 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-06T04:19:06.598 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-06T04:19:06.607 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-06T04:19:06.621 INFO:tasks.cephfs.test_acls:client is kernel mounted 2023-10-06T04:19:06.621 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:19:06.621 DEBUG:teuthology.orchestra.run.smithi037:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.9DYHaiFvvixfstests-dev && exec sudo ./check generic/099) 2023-10-06T04:19:06.826 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-10-06T04:19:06.830 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 4.18.0-425.3.1.el8.x86_64 #1 SMP Fri Sep 30 11:45:06 EDT 2022 2023-10-06T04:19:06.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:07.521 INFO:teuthology.orchestra.run.smithi037.stdout:generic/099 1s 2023-10-06T04:19:07.526 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/099 2023-10-06T04:19:07.526 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-10-06T04:19:07.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:07.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo userdel --force --remove fsgqa 2023-10-06T04:19:09.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo userdel --force --remove 123456-fsgqa 2023-10-06T04:19:11.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo groupdel fsgqa 2023-10-06T04:19:11.881 INFO:teuthology.orchestra.run.smithi037.stderr:groupdel: group 'fsgqa' does not exist 2023-10-06T04:19:11.881 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-06T04:19:11.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf /tmp/tmp.9DYHaiFvvixfstests-dev 2023-10-06T04:19:11.966 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:19:11.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:19:12.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:19:12.053 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:19:12.053 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:19:12.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:19:12.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:19:12.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:12.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:12.097 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:19:12.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:19:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.311+0000 7f7022e3f700 1 Processor -- start 2023-10-06T04:19:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.311+0000 7f7022e3f700 1 -- start start 2023-10-06T04:19:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7022e3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7022e3f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f701c150500 0x7f701c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7022e3f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c0a9860 con 0x7f701c0a93c0 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7022e3f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c0a9b40 con 0x7f701c150500 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7022e3f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0a9e20 con 0x7f701c06f230 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f70213dc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f701c150500 0x7f701c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f70213dc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f701c150500 0x7f701c157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47606/0 (socket says 172.21.15.37:47606) 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f70213dc700 1 -- 172.21.15.37:0/3236076521 learned_addr learned my addr 172.21.15.37:0/3236076521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.312+0000 7f7020bdb700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f70213dc700 1 -- 172.21.15.37:0/3236076521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 msgr2=0x7f701c0a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f70213dc700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f70213dc700 1 -- 172.21.15.37:0/3236076521 >> v1:172.21.15.83:6789/0 conn(0x7f701c0a93c0 legacy=0x7f701c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f70213dc700 1 -- 172.21.15.37:0/3236076521 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c1574f0 con 0x7f701c150500 2023-10-06T04:19:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f70213dc700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c157cf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f700c00bc50 tx=0x7f700c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c7817776edfa46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f701b7fe700 1 -- 172.21.15.37:0/3236076521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00be60 con 0x7f701c150500 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f701b7fe700 1 -- 172.21.15.37:0/3236076521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00de00 con 0x7f701c150500 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.313+0000 7f701b7fe700 1 -- 172.21.15.37:0/3236076521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c0196b0 con 0x7f701c150500 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 -- 172.21.15.37:0/3236076521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 msgr2=0x7f701c157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c157cf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f700c00bc50 tx=0x7f700c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 -- 172.21.15.37:0/3236076521 shutdown_connections 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c157cf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 --2- 172.21.15.37:0/3236076521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 -- 172.21.15.37:0/3236076521 >> 172.21.15.37:0/3236076521 conn(0x7f701c0cc250 msgr2=0x7f701c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 -- 172.21.15.37:0/3236076521 shutdown_connections 2023-10-06T04:19:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.314+0000 7f7022e3f700 1 -- 172.21.15.37:0/3236076521 wait complete. 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.315+0000 7f7022e3f700 1 Processor -- start 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.315+0000 7f7022e3f700 1 -- start start 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 0x7f701c166950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c168b70 con 0x7f701c150500 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0696e0 con 0x7f701c0a93c0 2023-10-06T04:19:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7022e3f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c06a260 con 0x7f701c06f230 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47612/0 (socket says 172.21.15.37:47612) 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 -- 172.21.15.37:0/2642958263 learned_addr learned my addr 172.21.15.37:0/2642958263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f7020bdb700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f701bfff700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 0x7f701c166950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 -- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 msgr2=0x7f701c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 -- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 msgr2=0x7f701c166950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 0x7f701c166950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 -- 172.21.15.37:0/2642958263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c00b790 con 0x7f701c150500 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f701bfff700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 0x7f701c166950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.316+0000 7f70213dc700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f701c069090 tx=0x7f700c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00be60 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c006bc0 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c069930 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c010cf0 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c069ef0 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.317+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c0ad530 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.318+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f700c022030 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.318+0000 7f7018ff9700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.318+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f700c014070 con 0x7f701c150500 2023-10-06T04:19:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.318+0000 7f7020bdb700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.319+0000 7f7020bdb700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 0x7f70080693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f701c14a410 tx=0x7f7014009810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.323+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f700c055b60 con 0x7f701c150500 2023-10-06T04:19:12.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.560+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f701c06a3d0 con 0x7f701c150500 2023-10-06T04:19:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.560+0000 7f7018ff9700 1 -- 172.21.15.37:0/2642958263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f700c059180 con 0x7f701c150500 2023-10-06T04:19:12.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:12.562 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:19:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 msgr2=0x7f70080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 0x7f70080693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f701c14a410 tx=0x7f7014009810 comp rx=0 tx=0).stop 2023-10-06T04:19:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 msgr2=0x7f701c0aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f701c069090 tx=0x7f700c01b000 comp rx=0 tx=0).stop 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 shutdown_connections 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f701c150500 0x7f701c0aa5c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f701c06f230 0x7f701c0acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f7008066f30 0x7f70080693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 --2- 172.21.15.37:0/2642958263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f701c0a93c0 0x7f701c166950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 >> 172.21.15.37:0/2642958263 conn(0x7f701c0cc250 msgr2=0x7f701c0cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 shutdown_connections 2023-10-06T04:19:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.563+0000 7f7022e3f700 1 -- 172.21.15.37:0/2642958263 wait complete. 2023-10-06T04:19:12.566 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:19:12.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:19:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.695+0000 7f632df66700 1 Processor -- start 2023-10-06T04:19:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.695+0000 7f632df66700 1 -- start start 2023-10-06T04:19:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f632813fb00 0x7f632806a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f632806ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f632806e660 0x7f632806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632806de40 con 0x7f632813fb00 2023-10-06T04:19:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280ca250 con 0x7f632806e660 2023-10-06T04:19:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632df66700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632806f390 con 0x7f63280c6670 2023-10-06T04:19:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f632813fb00 0x7f632806a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f632813fb00 0x7f632806a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47626/0 (socket says 172.21.15.37:47626) 2023-10-06T04:19:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 -- 172.21.15.37:0/1802906093 learned_addr learned my addr 172.21.15.37:0/1802906093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632d765700 1 --2- 172.21.15.37:0/1802906093 >> v2:172.21.15.83:3300/0 conn(0x7f632806e660 0x7f632806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f6327fff700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f632806ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 -- 172.21.15.37:0/1802906093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 msgr2=0x7f632806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f632806ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 -- 172.21.15.37:0/1802906093 >> v2:172.21.15.83:3300/0 conn(0x7f632806e660 msgr2=0x7f632806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 --2- 172.21.15.37:0/1802906093 >> v2:172.21.15.83:3300/0 conn(0x7f632806e660 0x7f632806eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f632cf64700 1 -- 172.21.15.37:0/1802906093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632806f670 con 0x7f632813fb00 2023-10-06T04:19:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.696+0000 7f6327fff700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f632806ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632cf64700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f632806a5c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f632806d460 tx=0x7f631c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b7458cad91ff3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f63277fe700 1 -- 172.21.15.37:0/1802906093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00dc50 con 0x7f632813fb00 2023-10-06T04:19:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f63277fe700 1 -- 172.21.15.37:0/1802906093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00ddb0 con 0x7f632813fb00 2023-10-06T04:19:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f63277fe700 1 -- 172.21.15.37:0/1802906093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0196d0 con 0x7f632813fb00 2023-10-06T04:19:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 -- 172.21.15.37:0/1802906093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 msgr2=0x7f632806a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f632806a5c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f632806d460 tx=0x7f631c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 -- 172.21.15.37:0/1802906093 shutdown_connections 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 --2- 172.21.15.37:0/1802906093 >> v2:172.21.15.83:3300/0 conn(0x7f632806e660 0x7f632806eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f632806a5c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 --2- 172.21.15.37:0/1802906093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f632806ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 -- 172.21.15.37:0/1802906093 >> 172.21.15.37:0/1802906093 conn(0x7f6328068130 msgr2=0x7f63280cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 -- 172.21.15.37:0/1802906093 shutdown_connections 2023-10-06T04:19:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.697+0000 7f632df66700 1 -- 172.21.15.37:0/1802906093 wait complete. 2023-10-06T04:19:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.698+0000 7f632df66700 1 Processor -- start 2023-10-06T04:19:12.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 -- start start 2023-10-06T04:19:12.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 0x7f632813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f63280c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b0620 con 0x7f632813fb00 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280aa320 con 0x7f632806e660 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.699+0000 7f632df66700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280aa600 con 0x7f63280c6670 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47630/0 (socket says 172.21.15.37:47630) 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 -- 172.21.15.37:0/46895845 learned_addr learned my addr 172.21.15.37:0/46895845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f6327fff700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f63280c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632cf64700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 0x7f632813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 -- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 msgr2=0x7f63280c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f63280c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 -- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 msgr2=0x7f632813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 0x7f632813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 -- 172.21.15.37:0/46895845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c00b790 con 0x7f632813fb00 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f6327fff700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f63280c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632cf64700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 0x7f632813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632d765700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6320009fa0 tx=0x7f6320009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632000ed20 con 0x7f632813fb00 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632000ee80 con 0x7f632813fb00 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280b08c0 con 0x7f632813fb00 2023-10-06T04:19:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320014670 con 0x7f632813fb00 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.700+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63280aef90 con 0x7f632813fb00 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.701+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632804c3c0 con 0x7f632813fb00 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.702+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63200149e0 con 0x7f632813fb00 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.702+0000 7f6324ff9700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 0x7f630c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.702+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f6320084eb0 con 0x7f632813fb00 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.703+0000 7f632cf64700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 0x7f630c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.703+0000 7f632cf64700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 0x7f630c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f632806d460 tx=0x7f631c01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.707+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6320051fa0 con 0x7f632813fb00 2023-10-06T04:19:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.902+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63280c9c00 con 0x7f632813fb00 2023-10-06T04:19:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.903+0000 7f6324ff9700 1 -- 172.21.15.37:0/46895845 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f63200555c0 con 0x7f632813fb00 2023-10-06T04:19:12.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:12.905 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:18:37.756218+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:19:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 msgr2=0x7f630c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 0x7f630c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f632806d460 tx=0x7f631c01b000 comp rx=0 tx=0).stop 2023-10-06T04:19:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 msgr2=0x7f63280a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6320009fa0 tx=0x7f6320009900 comp rx=0 tx=0).stop 2023-10-06T04:19:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 shutdown_connections 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f632813fb00 0x7f63280a98d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f630c066f30 0x7f630c0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f632806e660 0x7f632813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 --2- 172.21.15.37:0/46895845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63280c6670 0x7f63280c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.905+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 >> 172.21.15.37:0/46895845 conn(0x7f6328068130 msgr2=0x7f63280694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.906+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 shutdown_connections 2023-10-06T04:19:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:12.906+0000 7f632df66700 1 -- 172.21.15.37:0/46895845 wait complete. 2023-10-06T04:19:12.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:16:41.535173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:16:48.653427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:17:42.697839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:17:43.387985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:19:12.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:19:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 Processor -- start 2023-10-06T04:19:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 -- start start 2023-10-06T04:19:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f581006bbb0 0x7f58100c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5810157910 0x7f58100c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58100ccd00 con 0x7f581006bf80 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581015c290 con 0x7f581006bbb0 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.041+0000 7f58161a7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100c9620 con 0x7f5810157910 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f581006bbb0 0x7f58100c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f581006bbb0 0x7f58100c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47646/0 (socket says 172.21.15.37:47646) 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 -- 172.21.15.37:0/1011626288 learned_addr learned my addr 172.21.15.37:0/1011626288 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 -- 172.21.15.37:0/1011626288 >> v2:172.21.15.83:3300/0 conn(0x7f5810157910 msgr2=0x7f58100c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 --2- 172.21.15.37:0/1011626288 >> v2:172.21.15.83:3300/0 conn(0x7f5810157910 0x7f58100c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 -- 172.21.15.37:0/1011626288 >> v1:172.21.15.83:6789/0 conn(0x7f581006bf80 legacy=0x7f5810157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 -- 172.21.15.37:0/1011626288 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100b1230 con 0x7f581006bbb0 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580f7fe700 1 --2- 172.21.15.37:0/1011626288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bbb0 0x7f58100c8ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f581006f350 tx=0x7f5800009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb003928ab534ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580e7fc700 1 -- 172.21.15.37:0/1011626288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800005c10 con 0x7f581006bbb0 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580e7fc700 1 -- 172.21.15.37:0/1011626288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800005d70 con 0x7f581006bbb0 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.042+0000 7f580e7fc700 1 -- 172.21.15.37:0/1011626288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000b840 con 0x7f581006bbb0 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 -- 172.21.15.37:0/1011626288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bbb0 msgr2=0x7f58100c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 --2- 172.21.15.37:0/1011626288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bbb0 0x7f58100c8ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f581006f350 tx=0x7f5800009220 comp rx=0 tx=0).stop 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 -- 172.21.15.37:0/1011626288 shutdown_connections 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 --2- 172.21.15.37:0/1011626288 >> v2:172.21.15.83:3300/0 conn(0x7f5810157910 0x7f58100c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 --2- 172.21.15.37:0/1011626288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bbb0 0x7f58100c8ab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 -- 172.21.15.37:0/1011626288 >> 172.21.15.37:0/1011626288 conn(0x7f58100ce470 msgr2=0x7f58100ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 -- 172.21.15.37:0/1011626288 shutdown_connections 2023-10-06T04:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.043+0000 7f58161a7700 1 -- 172.21.15.37:0/1011626288 wait complete. 2023-10-06T04:19:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.044+0000 7f58161a7700 1 Processor -- start 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.044+0000 7f58161a7700 1 -- start start 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581006bbb0 0x7f5810149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5810157910 0x7f58100c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810157f00 con 0x7f581006bf80 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581006a370 con 0x7f5810157910 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f58161a7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b3040 con 0x7f581006bbb0 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47652/0 (socket says 172.21.15.37:47652) 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 -- 172.21.15.37:0/2194549651 learned_addr learned my addr 172.21.15.37:0/2194549651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580ffff700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5810157910 0x7f58100c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580f7fe700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581006bbb0 0x7f5810149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 -- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581006bbb0 msgr2=0x7f5810149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581006bbb0 0x7f5810149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 -- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5810157910 msgr2=0x7f58100c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5810157910 0x7f58100c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 -- 172.21.15.37:0/2194549651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009480 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.045+0000 7f580effd700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f580400b600 tx=0x7f58040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400f510 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400f670 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400fa30 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58100b3320 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810149690 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.046+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810158070 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.047+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f580401a400 con 0x7f581006bf80 2023-10-06T04:19:13.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.047+0000 7f57f77fe700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 0x7f57fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.047+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f58040841e0 con 0x7f581006bf80 2023-10-06T04:19:13.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.047+0000 7f580f7fe700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 0x7f57fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.048+0000 7f580f7fe700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 0x7f57fc0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5800003080 tx=0x7f5800015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.051+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5810158070 con 0x7f581006bf80 2023-10-06T04:19:13.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.242+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5810158040 con 0x7f581006bf80 2023-10-06T04:19:13.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.243+0000 7f57f77fe700 1 -- 172.21.15.37:0/2194549651 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5804051350 con 0x7f581006bf80 2023-10-06T04:19:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 msgr2=0x7f57fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 0x7f57fc0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5800003080 tx=0x7f5800015000 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 msgr2=0x7f58100c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f580400b600 tx=0x7f58040091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 shutdown_connections 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f57fc066f30 0x7f57fc0693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5810157910 0x7f58100c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f581006bbb0 0x7f5810149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 --2- 172.21.15.37:0/2194549651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006bf80 0x7f58100c3d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 >> 172.21.15.37:0/2194549651 conn(0x7f58100ce470 msgr2=0x7f58100cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 shutdown_connections 2023-10-06T04:19:13.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.245+0000 7f58161a7700 1 -- 172.21.15.37:0/2194549651 wait complete. 2023-10-06T04:19:13.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:19:13.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.379+0000 7f4705b2b700 1 Processor -- start 2023-10-06T04:19:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.379+0000 7f4705b2b700 1 -- start start 2023-10-06T04:19:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4705b2b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4705b2b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f470015ad10 0x7f47000cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4705b2b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47000cf180 con 0x7f47000af590 2023-10-06T04:19:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4705b2b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47000cbb50 con 0x7f470015ad10 2023-10-06T04:19:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4705b2b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47000ce5e0 con 0x7f470015a7f0 2023-10-06T04:19:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f470532a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f470015ad10 0x7f47000cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4704b29700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47000af590 0x7f47000cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53790/0 (socket says 172.21.15.37:53790) 2023-10-06T04:19:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f4704b29700 1 -- 172.21.15.37:0/351948725 learned_addr learned my addr 172.21.15.37:0/351948725 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f46fffff700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f46ff7fe700 1 -- 172.21.15.37:0/351948725 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746119346 0 0) 0x7f47000cf180 con 0x7f47000af590 2023-10-06T04:19:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f46ff7fe700 1 -- 172.21.15.37:0/351948725 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e8003570 con 0x7f47000af590 2023-10-06T04:19:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f470532a700 1 -- 172.21.15.37:0/351948725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 msgr2=0x7f47000af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f470532a700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f470532a700 1 -- 172.21.15.37:0/351948725 >> v1:172.21.15.37:6789/0 conn(0x7f47000af590 legacy=0x7f47000cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.380+0000 7f470532a700 1 -- 172.21.15.37:0/351948725 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470015b170 con 0x7f470015ad10 2023-10-06T04:19:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f470532a700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470015ad10 0x7f47000cce70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009e60 tx=0x7f46f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f235e2e716b3965b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f46ff7fe700 1 -- 172.21.15.37:0/351948725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f800e070 con 0x7f470015ad10 2023-10-06T04:19:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f46ff7fe700 1 -- 172.21.15.37:0/351948725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f800bab0 con 0x7f470015ad10 2023-10-06T04:19:13.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f46ff7fe700 1 -- 172.21.15.37:0/351948725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f800be70 con 0x7f470015ad10 2023-10-06T04:19:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 -- 172.21.15.37:0/351948725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470015ad10 msgr2=0x7f47000cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470015ad10 0x7f47000cce70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009e60 tx=0x7f46f8009780 comp rx=0 tx=0).stop 2023-10-06T04:19:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 -- 172.21.15.37:0/351948725 shutdown_connections 2023-10-06T04:19:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470015ad10 0x7f47000cce70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 --2- 172.21.15.37:0/351948725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 -- 172.21.15.37:0/351948725 >> 172.21.15.37:0/351948725 conn(0x7f470006a3f0 msgr2=0x7f470006ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 -- 172.21.15.37:0/351948725 shutdown_connections 2023-10-06T04:19:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.381+0000 7f4705b2b700 1 -- 172.21.15.37:0/351948725 wait complete. 2023-10-06T04:19:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.382+0000 7f4705b2b700 1 Processor -- start 2023-10-06T04:19:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 -- start start 2023-10-06T04:19:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 0x7f47000c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470014c590 con 0x7f47000af590 2023-10-06T04:19:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47000c7d00 con 0x7f470015ad10 2023-10-06T04:19:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4705b2b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47000b06f0 con 0x7f470015a7f0 2023-10-06T04:19:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4704b29700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4704b29700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47672/0 (socket says 172.21.15.37:47672) 2023-10-06T04:19:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.383+0000 7f4704b29700 1 -- 172.21.15.37:0/4234256936 learned_addr learned my addr 172.21.15.37:0/4234256936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f470532a700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 0x7f47000c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f46fffff700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 -- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 msgr2=0x7f47000b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 -- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 msgr2=0x7f47000c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 0x7f47000c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 -- 172.21.15.37:0/4234256936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009a20 con 0x7f47000af590 2023-10-06T04:19:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f470532a700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 0x7f47000c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4704b29700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c7f0 tx=0x7f46f0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0005b30 con 0x7f47000af590 2023-10-06T04:19:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0005c90 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47000c7a20 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0007340 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.384+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47000b0380 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.385+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470004c3c0 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.385+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46f001b400 con 0x7f47000af590 2023-10-06T04:19:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.386+0000 7f46fcff9700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 0x7f46ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.386+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f46f00842f0 con 0x7f47000af590 2023-10-06T04:19:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.386+0000 7f46fffff700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 0x7f46ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.387+0000 7f46fffff700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 0x7f46ec0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009d40 tx=0x7f46f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.390+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46f00513f0 con 0x7f47000af590 2023-10-06T04:19:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.582+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47000ce850 con 0x7f47000af590 2023-10-06T04:19:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.582+0000 7f46fcff9700 1 -- 172.21.15.37:0/4234256936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46f00076f0 con 0x7f47000af590 2023-10-06T04:19:13.584 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T04:19:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 msgr2=0x7f46ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 0x7f46ec0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009d40 tx=0x7f46f4008040 comp rx=0 tx=0).stop 2023-10-06T04:19:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 msgr2=0x7f470014c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c7f0 tx=0x7f46f0007e00 comp rx=0 tx=0).stop 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 shutdown_connections 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f46ec066f30 0x7f46ec0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f470015ad10 0x7f47000c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47000af590 0x7f470014c050 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 --2- 172.21.15.37:0/4234256936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f470015a7f0 0x7f47000b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.584+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 >> 172.21.15.37:0/4234256936 conn(0x7f470006a3f0 msgr2=0x7f470015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.585+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 shutdown_connections 2023-10-06T04:19:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.585+0000 7f4705b2b700 1 -- 172.21.15.37:0/4234256936 wait complete. 2023-10-06T04:19:13.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:19:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.718+0000 7f433359e700 1 Processor -- start 2023-10-06T04:19:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.719+0000 7f433359e700 1 -- start start 2023-10-06T04:19:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.719+0000 7f433359e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f43340b2810 0x7f43340cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.719+0000 7f433359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43340cb470 0x7f433415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433359e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340cf460 con 0x7f43340ccb90 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43340cfe30 con 0x7f43340cb470 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433359e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4334159b20 con 0x7f43340b2810 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43340cb470 0x7f433415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4332d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43340ccb90 0x7f43340ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53806/0 (socket says 172.21.15.37:53806) 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4332d9d700 1 -- 172.21.15.37:0/3952975955 learned_addr learned my addr 172.21.15.37:0/3952975955 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433259c700 1 --2- 172.21.15.37:0/3952975955 >> v2:172.21.15.83:3300/0 conn(0x7f43340b2810 0x7f43340cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 -- 172.21.15.37:0/3952975955 >> v2:172.21.15.83:3300/0 conn(0x7f43340b2810 msgr2=0x7f43340cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 --2- 172.21.15.37:0/3952975955 >> v2:172.21.15.83:3300/0 conn(0x7f43340b2810 0x7f43340cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 -- 172.21.15.37:0/3952975955 >> v1:172.21.15.37:6789/0 conn(0x7f43340ccb90 legacy=0x7f43340ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 -- 172.21.15.37:0/3952975955 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43340ce890 con 0x7f43340cb470 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433159a700 1 -- 172.21.15.37:0/3952975955 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198090415 0 0) 0x7f43340cf460 con 0x7f43340ccb90 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f4331d9b700 1 --2- 172.21.15.37:0/3952975955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340cb470 0x7f433415db70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f431c0098e0 tx=0x7f431c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720d8a196596b51b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433159a700 1 -- 172.21.15.37:0/3952975955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c009e80 con 0x7f43340cb470 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433159a700 1 -- 172.21.15.37:0/3952975955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00b820 con 0x7f43340cb470 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.720+0000 7f433159a700 1 -- 172.21.15.37:0/3952975955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00bba0 con 0x7f43340cb470 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 -- 172.21.15.37:0/3952975955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340cb470 msgr2=0x7f433415db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 --2- 172.21.15.37:0/3952975955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340cb470 0x7f433415db70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f431c0098e0 tx=0x7f431c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 -- 172.21.15.37:0/3952975955 shutdown_connections 2023-10-06T04:19:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 --2- 172.21.15.37:0/3952975955 >> v2:172.21.15.83:3300/0 conn(0x7f43340b2810 0x7f43340cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 --2- 172.21.15.37:0/3952975955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340cb470 0x7f433415db70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 -- 172.21.15.37:0/3952975955 >> 172.21.15.37:0/3952975955 conn(0x7f433406ed90 msgr2=0x7f433406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 -- 172.21.15.37:0/3952975955 shutdown_connections 2023-10-06T04:19:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.721+0000 7f433359e700 1 -- 172.21.15.37:0/3952975955 wait complete. 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.722+0000 7f433359e700 1 Processor -- start 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.722+0000 7f433359e700 1 -- start start 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43340b2810 0x7f433416d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 0x7f4334151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340c8870 con 0x7f43340ccb90 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334151550 con 0x7f43340b2810 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433359e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b50e0 con 0x7f43340cb470 2023-10-06T04:19:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47696/0 (socket says 172.21.15.37:47696) 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 -- 172.21.15.37:0/4232716921 learned_addr learned my addr 172.21.15.37:0/4232716921 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f433259c700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43340b2810 0x7f433416d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4331d9b700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 0x7f4334151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 -- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 msgr2=0x7f4334151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 0x7f4334151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 -- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43340b2810 msgr2=0x7f433416d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43340b2810 0x7f433416d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 -- 172.21.15.37:0/4232716921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009420 con 0x7f43340ccb90 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4331d9b700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 0x7f4334151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.723+0000 7f4332d9d700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f432c00cc90 tx=0x7f432c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.724+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00cea0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.724+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00ab30 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.724+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433416d6f0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.724+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0070f0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.724+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433416dcb0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.725+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43340b2de0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.725+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f432c0074a0 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.725+0000 7f432a7fc700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.725+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f432c084c20 con 0x7f43340ccb90 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.726+0000 7f433259c700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.726+0000 7f433259c700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 0x7f43140693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4324006fd0 tx=0x7f4324008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.729+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f432c051d00 con 0x7f43340ccb90 2023-10-06T04:19:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.921+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f433404c3c0 con 0x7f43340ccb90 2023-10-06T04:19:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.922+0000 7f432a7fc700 1 -- 172.21.15.37:0/4232716921 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f432c055320 con 0x7f43340ccb90 2023-10-06T04:19:13.923 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.923+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 msgr2=0x7f43140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.923+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 0x7f43140693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4324006fd0 tx=0x7f4324008040 comp rx=0 tx=0).stop 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.923+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 msgr2=0x7f43340b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.923+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f432c00cc90 tx=0x7f432c001a20 comp rx=0 tx=0).stop 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 shutdown_connections 2023-10-06T04:19:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43340ccb90 0x7f43340b4ba0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4314066f30 0x7f43140693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43340b2810 0x7f433416d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 --2- 172.21.15.37:0/4232716921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43340cb470 0x7f4334151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 >> 172.21.15.37:0/4232716921 conn(0x7f433406ed90 msgr2=0x7f43340b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 shutdown_connections 2023-10-06T04:19:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:13.924+0000 7f433359e700 1 -- 172.21.15.37:0/4232716921 wait complete. 2023-10-06T04:19:13.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:19:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.058+0000 7f093759e700 1 Processor -- start 2023-10-06T04:19:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.058+0000 7f093759e700 1 -- start start 2023-10-06T04:19:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093759e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f09380b2810 0x7f09380cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093759e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09380cf460 con 0x7f09380ccb90 2023-10-06T04:19:14.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093759e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09380cfe30 con 0x7f09380b2810 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0938159b20 con 0x7f09380cb470 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f0935d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f093659c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f09380b2810 0x7f09380cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f0935d9b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:59366/0 (socket says 172.21.15.37:59366) 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f0936d9d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f09380ccb90 0x7f09380ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.37:47868/0 (socket says 172.21.15.37:47868) 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.059+0000 7f0935d9b700 1 -- 172.21.15.37:0/385336843 learned_addr learned my addr 172.21.15.37:0/385336843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093659c700 1 -- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 msgr2=0x7f093815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093659c700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093659c700 1 -- 172.21.15.37:0/385336843 >> v1:172.21.15.83:6789/0 conn(0x7f09380ccb90 legacy=0x7f09380ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093659c700 1 -- 172.21.15.37:0/385336843 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380ce890 con 0x7f09380b2810 2023-10-06T04:19:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f0935d9b700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:19:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093659c700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380b2810 0x7f09380cf8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e60 tx=0x7f0928009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b54fca6e3efe23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093559a700 1 -- 172.21.15.37:0/385336843 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800e070 con 0x7f09380b2810 2023-10-06T04:19:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093559a700 1 -- 172.21.15.37:0/385336843 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092800bb60 con 0x7f09380b2810 2023-10-06T04:19:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093559a700 1 -- 172.21.15.37:0/385336843 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928012430 con 0x7f09380b2810 2023-10-06T04:19:14.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093759e700 1 -- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380b2810 msgr2=0x7f09380cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.060+0000 7f093759e700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380b2810 0x7f09380cf8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e60 tx=0x7f0928009780 comp rx=0 tx=0).stop 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 -- 172.21.15.37:0/385336843 shutdown_connections 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380b2810 0x7f09380cf8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 --2- 172.21.15.37:0/385336843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380cb470 0x7f093815db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 -- 172.21.15.37:0/385336843 >> 172.21.15.37:0/385336843 conn(0x7f093806ed90 msgr2=0x7f093806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 -- 172.21.15.37:0/385336843 shutdown_connections 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.061+0000 7f093759e700 1 -- 172.21.15.37:0/385336843 wait complete. 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 Processor -- start 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 -- start start 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 0x7f093815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380ccb90 0x7f093815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093815b1f0 con 0x7f09380b2810 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093816ac00 con 0x7f09380cb470 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.062+0000 7f093759e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093816a010 con 0x7f09380ccb90 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47700/0 (socket says 172.21.15.37:47700) 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 -- 172.21.15.37:0/3405399572 learned_addr learned my addr 172.21.15.37:0/3405399572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f0935d9b700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 0x7f093815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f0936d9d700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380ccb90 0x7f093815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 -- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380ccb90 msgr2=0x7f093815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380ccb90 0x7f093815acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 -- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 msgr2=0x7f093815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 0x7f093815a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 -- 172.21.15.37:0/3405399572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200094f0 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f0935d9b700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 0x7f093815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093659c700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0938070da0 tx=0x7f0928019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928012c30 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928012db0 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928009a20 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280276c0 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.063+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093816a5b0 con 0x7f09380b2810 2023-10-06T04:19:14.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.064+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093804c3c0 con 0x7f09380b2810 2023-10-06T04:19:14.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.065+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0928024070 con 0x7f09380b2810 2023-10-06T04:19:14.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.065+0000 7f092e7fc700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 0x7f09180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.065+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0928086ae0 con 0x7f09380b2810 2023-10-06T04:19:14.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.065+0000 7f0935d9b700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 0x7f09180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.066+0000 7f0935d9b700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 0x7f09180693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0938167c00 tx=0x7f0920009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.070+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0928053bd0 con 0x7f09380b2810 2023-10-06T04:19:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.265+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09380afb10 con 0x7f09380b2810 2023-10-06T04:19:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.266+0000 7f092e7fc700 1 -- 172.21.15.37:0/3405399572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f092802c0a0 con 0x7f09380b2810 2023-10-06T04:19:14.267 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T04:19:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 msgr2=0x7f09180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 0x7f09180693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0938167c00 tx=0x7f0920009250 comp rx=0 tx=0).stop 2023-10-06T04:19:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 msgr2=0x7f09380b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0938070da0 tx=0x7f0928019000 comp rx=0 tx=0).stop 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 shutdown_connections 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09380ccb90 0x7f093815acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09380b2810 0x7f09380b55f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0918066f30 0x7f09180693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 --2- 172.21.15.37:0/3405399572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09380cb470 0x7f093815a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.267+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 >> 172.21.15.37:0/3405399572 conn(0x7f093806ed90 msgr2=0x7f0938068500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.268+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 shutdown_connections 2023-10-06T04:19:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.268+0000 7f093759e700 1 -- 172.21.15.37:0/3405399572 wait complete. 2023-10-06T04:19:14.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:19:14.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.398+0000 7ff1a575e700 1 Processor -- start 2023-10-06T04:19:14.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.398+0000 7ff1a575e700 1 -- start start 2023-10-06T04:19:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a575e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1a00b2810 0x7ff1a00cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a575e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00cb470 0x7ff1a015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a575e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a00cf460 con 0x7ff1a00ccb90 2023-10-06T04:19:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a575e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a00cfe30 con 0x7ff1a00b2810 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a575e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0159b20 con 0x7ff1a00cb470 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff19ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1a00b2810 0x7ff1a00cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a4f5d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff1a00ccb90 0x7ff1a00ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53814/0 (socket says 172.21.15.37:53814) 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff1a4f5d700 1 -- 172.21.15.37:0/4157576758 learned_addr learned my addr 172.21.15.37:0/4157576758 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff19f7fe700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00cb470 0x7ff1a015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff19ffff700 1 -- 172.21.15.37:0/4157576758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00cb470 msgr2=0x7ff1a015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff19ffff700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00cb470 0x7ff1a015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.399+0000 7ff19ffff700 1 -- 172.21.15.37:0/4157576758 >> v1:172.21.15.37:6789/0 conn(0x7ff1a00ccb90 legacy=0x7ff1a00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19effd700 1 -- 172.21.15.37:0/4157576758 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381518569 0 0) 0x7ff1a00cf460 con 0x7ff1a00ccb90 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19ffff700 1 -- 172.21.15.37:0/4157576758 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00ce890 con 0x7ff1a00b2810 2023-10-06T04:19:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19ffff700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00b2810 0x7ff1a00cf8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff1880098e0 tx=0x7ff1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf78407e81c9144 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19effd700 1 -- 172.21.15.37:0/4157576758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188009e80 con 0x7ff1a00b2810 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19effd700 1 -- 172.21.15.37:0/4157576758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800b860 con 0x7ff1a00b2810 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff19effd700 1 -- 172.21.15.37:0/4157576758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800bbe0 con 0x7ff1a00b2810 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 -- 172.21.15.37:0/4157576758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00b2810 msgr2=0x7ff1a00cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00b2810 0x7ff1a00cf8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff1880098e0 tx=0x7ff1880091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 -- 172.21.15.37:0/4157576758 shutdown_connections 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00b2810 0x7ff1a00cf8f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 --2- 172.21.15.37:0/4157576758 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00cb470 0x7ff1a015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 -- 172.21.15.37:0/4157576758 >> 172.21.15.37:0/4157576758 conn(0x7ff1a006ed90 msgr2=0x7ff1a006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 -- 172.21.15.37:0/4157576758 shutdown_connections 2023-10-06T04:19:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.400+0000 7ff1a575e700 1 -- 172.21.15.37:0/4157576758 wait complete. 2023-10-06T04:19:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.401+0000 7ff1a575e700 1 Processor -- start 2023-10-06T04:19:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 -- start start 2023-10-06T04:19:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a00b2810 0x7ff1a0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00ccb90 0x7ff1a016cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a015a340 con 0x7ff1a00cb470 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a015cfc0 con 0x7ff1a00b2810 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.402+0000 7ff1a575e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a016d6d0 con 0x7ff1a00ccb90 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47730/0 (socket says 172.21.15.37:47730) 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 -- 172.21.15.37:0/2500587989 learned_addr learned my addr 172.21.15.37:0/2500587989 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff1a4f5d700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00ccb90 0x7ff1a016cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19ffff700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a00b2810 0x7ff1a0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 -- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00ccb90 msgr2=0x7ff1a016cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00ccb90 0x7ff1a016cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 -- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a00b2810 msgr2=0x7ff1a0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a00b2810 0x7ff1a0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 -- 172.21.15.37:0/2500587989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188009420 con 0x7ff1a00cb470 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff19f7fe700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff19000d8c0 tx=0x7ff190008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000de60 con 0x7ff1a00cb470 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000b780 con 0x7ff1a00cb470 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a016d9b0 con 0x7ff1a00cb470 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000bb20 con 0x7ff1a00cb470 2023-10-06T04:19:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.403+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a015a520 con 0x7ff1a00cb470 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.404+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a015a6e0 con 0x7ff1a00cb470 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.405+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff19001e460 con 0x7ff1a00cb470 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.405+0000 7ff197fff700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 0x7ff1800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.405+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff190084d50 con 0x7ff1a00cb470 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.405+0000 7ff19ffff700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 0x7ff1800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.406+0000 7ff19ffff700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 0x7ff1800693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1880091e0 tx=0x7ff188017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.409+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff190088030 con 0x7ff1a00cb470 2023-10-06T04:19:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.648+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1a015a890 con 0x7ff1a00cb470 2023-10-06T04:19:14.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.648+0000 7ff197fff700 1 -- 172.21.15.37:0/2500587989 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff190051e40 con 0x7ff1a00cb470 2023-10-06T04:19:14.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:14.650 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:19:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 msgr2=0x7ff1800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 0x7ff1800693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1880091e0 tx=0x7ff188017000 comp rx=0 tx=0).stop 2023-10-06T04:19:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 msgr2=0x7ff1a0146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff19000d8c0 tx=0x7ff190008040 comp rx=0 tx=0).stop 2023-10-06T04:19:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 shutdown_connections 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1a00ccb90 0x7ff1a016cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff180066f30 0x7ff1800693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1a00b2810 0x7ff1a0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 --2- 172.21.15.37:0/2500587989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a00cb470 0x7ff1a0146870 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 >> 172.21.15.37:0/2500587989 conn(0x7ff1a006ed90 msgr2=0x7ff1a00af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 shutdown_connections 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.650+0000 7ff1a575e700 1 -- 172.21.15.37:0/2500587989 wait complete. 2023-10-06T04:19:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:19:14.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:19:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.782+0000 7f49cb34f700 1 Processor -- start 2023-10-06T04:19:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.782+0000 7f49cb34f700 1 -- start start 2023-10-06T04:19:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f49c40b5e30 0x7f49c415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49c40b6200 0x7f49c415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40ad0f0 0x7f49c40ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40ae9f0 con 0x7f49c40b6200 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40adde0 con 0x7f49c40b5e30 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49cb34f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40ae0c0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49c88ea700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49c40b6200 0x7f49c415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49c88ea700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49c40b6200 0x7f49c415daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47742/0 (socket says 172.21.15.37:47742) 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49c88ea700 1 -- 172.21.15.37:0/4181719894 learned_addr learned my addr 172.21.15.37:0/4181719894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49c90eb700 1 --2- 172.21.15.37:0/4181719894 >> v2:172.21.15.83:3300/0 conn(0x7f49c40b5e30 0x7f49c415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.783+0000 7f49c98ec700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40ad0f0 0x7f49c40ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 -- 172.21.15.37:0/4181719894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40ad0f0 msgr2=0x7f49c40ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40ad0f0 0x7f49c40ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 -- 172.21.15.37:0/4181719894 >> v2:172.21.15.83:3300/0 conn(0x7f49c40b5e30 msgr2=0x7f49c415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 --2- 172.21.15.37:0/4181719894 >> v2:172.21.15.83:3300/0 conn(0x7f49c40b5e30 0x7f49c415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 -- 172.21.15.37:0/4181719894 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40ae3a0 con 0x7f49c40b6200 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c88ea700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40b6200 0x7f49c415daa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f49c4064840 tx=0x7f49b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a71521ea1de463 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c3fff700 1 -- 172.21.15.37:0/4181719894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b800b640 con 0x7f49c40b6200 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c3fff700 1 -- 172.21.15.37:0/4181719894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b800b7a0 con 0x7f49c40b6200 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.784+0000 7f49c3fff700 1 -- 172.21.15.37:0/4181719894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b800bb40 con 0x7f49c40b6200 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 -- 172.21.15.37:0/4181719894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40b6200 msgr2=0x7f49c415daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40b6200 0x7f49c415daa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f49c4064840 tx=0x7f49b8009250 comp rx=0 tx=0).stop 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 -- 172.21.15.37:0/4181719894 shutdown_connections 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40ad0f0 0x7f49c40ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 --2- 172.21.15.37:0/4181719894 >> v2:172.21.15.83:3300/0 conn(0x7f49c40b5e30 0x7f49c415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 --2- 172.21.15.37:0/4181719894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40b6200 0x7f49c415daa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 -- 172.21.15.37:0/4181719894 >> 172.21.15.37:0/4181719894 conn(0x7f49c4099a10 msgr2=0x7f49c406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 -- 172.21.15.37:0/4181719894 shutdown_connections 2023-10-06T04:19:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.785+0000 7f49cb34f700 1 -- 172.21.15.37:0/4181719894 wait complete. 2023-10-06T04:19:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.786+0000 7f49cb34f700 1 Processor -- start 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.786+0000 7f49cb34f700 1 -- start start 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 0x7f49c415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49c40b6200 0x7f49c409d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4142b90 con 0x7f49c40ad0f0 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415b990 con 0x7f49c40b6200 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49cb34f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415a3b0 con 0x7f49c40b5e30 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47754/0 (socket says 172.21.15.37:47754) 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 -- 172.21.15.37:0/3223738813 learned_addr learned my addr 172.21.15.37:0/3223738813 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c88ea700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 0x7f49c415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c98ec700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49c40b6200 0x7f49c409d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 -- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 msgr2=0x7f49c415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 0x7f49c415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 -- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49c40b6200 msgr2=0x7f49c409d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49c40b6200 0x7f49c409d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 -- 172.21.15.37:0/3223738813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80094f0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c88ea700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 0x7f49c415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c90eb700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ef0 tx=0x7f49bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.787+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00cc50 con 0x7f49c40ad0f0 2023-10-06T04:19:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.788+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00f040 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.788+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c415a690 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.788+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc014480 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.788+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c415acd0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.788+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c40b2f90 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.789+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49bc0147f0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.789+0000 7f49c17fa700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 0x7f49b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.789+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f49bc0850f0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.790+0000 7f49c88ea700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 0x7f49b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.790+0000 7f49c88ea700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 0x7f49b00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f49c4064840 tx=0x7f49b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.794+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49bc0521e0 con 0x7f49c40ad0f0 2023-10-06T04:19:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.989+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c40ae680 con 0x7f49c40ad0f0 2023-10-06T04:19:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.990+0000 7f49c17fa700 1 -- 172.21.15.37:0/3223738813 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f49bc055800 con 0x7f49c40ad0f0 2023-10-06T04:19:14.992 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:14.992 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:18:37.756218+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:19:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.992+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 msgr2=0x7f49b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.992+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 0x7f49b00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f49c4064840 tx=0x7f49b8017000 comp rx=0 tx=0).stop 2023-10-06T04:19:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.992+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 msgr2=0x7f49c416a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.992+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009ef0 tx=0x7f49bc00b040 comp rx=0 tx=0).stop 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 shutdown_connections 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f49b0066f30 0x7f49b00693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49c40b6200 0x7f49c409d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c40ad0f0 0x7f49c416a0f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 --2- 172.21.15.37:0/3223738813 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49c40b5e30 0x7f49c415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 >> 172.21.15.37:0/3223738813 conn(0x7f49c4099a10 msgr2=0x7f49c4158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 shutdown_connections 2023-10-06T04:19:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:14.993+0000 7f49cb34f700 1 -- 172.21.15.37:0/3223738813 wait complete. 2023-10-06T04:19:15.007 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:19:15.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:19:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.124+0000 7faec73f6700 1 Processor -- start 2023-10-06T04:19:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.125+0000 7faec73f6700 1 -- start start 2023-10-06T04:19:15.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec73f6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faec00b5e30 0x7faec015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec73f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec73f6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00ae9f0 con 0x7faec00ad0f0 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec73f6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00adde0 con 0x7faec00b5e30 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec73f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00ae0c0 con 0x7faec00b6200 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faec00b5e30 0x7faec015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faec00b5e30 0x7faec015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47764/0 (socket says 172.21.15.37:47764) 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 -- 172.21.15.37:0/2219601070 learned_addr learned my addr 172.21.15.37:0/2219601070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec4991700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 -- 172.21.15.37:0/2219601070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 msgr2=0x7faec015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec015daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 -- 172.21.15.37:0/2219601070 >> v1:172.21.15.83:6789/0 conn(0x7faec00ad0f0 legacy=0x7faec00ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 -- 172.21.15.37:0/2219601070 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00ae3a0 con 0x7faec00b5e30 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faec5192700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec015d560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faeb00099b0 tx=0x7faeb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24128cb0eb5ba4d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faebffff700 1 -- 172.21.15.37:0/2219601070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000b860 con 0x7faec00b5e30 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faebffff700 1 -- 172.21.15.37:0/2219601070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000b9c0 con 0x7faec00b5e30 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.126+0000 7faebffff700 1 -- 172.21.15.37:0/2219601070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000bd80 con 0x7faec00b5e30 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 -- 172.21.15.37:0/2219601070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 msgr2=0x7faec015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec015d560 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faeb00099b0 tx=0x7faeb0009250 comp rx=0 tx=0).stop 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 -- 172.21.15.37:0/2219601070 shutdown_connections 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec015d560 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 --2- 172.21.15.37:0/2219601070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 -- 172.21.15.37:0/2219601070 >> 172.21.15.37:0/2219601070 conn(0x7faec0099a10 msgr2=0x7faec006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 -- 172.21.15.37:0/2219601070 shutdown_connections 2023-10-06T04:19:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.127+0000 7faec73f6700 1 -- 172.21.15.37:0/2219601070 wait complete. 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.128+0000 7faec73f6700 1 Processor -- start 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.128+0000 7faec73f6700 1 -- start start 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec00ad0f0 0x7faec009b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec016c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec009b930 con 0x7faec00b5e30 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec016b460 con 0x7faec00ad0f0 2023-10-06T04:19:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec73f6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec016b740 con 0x7faec00b6200 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47778/0 (socket says 172.21.15.37:47778) 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 -- 172.21.15.37:0/2331603051 learned_addr learned my addr 172.21.15.37:0/2331603051 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec5192700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec00ad0f0 0x7faec009b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec5993700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec016c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 -- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 msgr2=0x7faec016c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec016c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 -- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec00ad0f0 msgr2=0x7faec009b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec00ad0f0 0x7faec009b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 -- 172.21.15.37:0/2331603051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00094f0 con 0x7faec00b5e30 2023-10-06T04:19:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.129+0000 7faec4991700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d860 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40125f0 con 0x7faec00b5e30 2023-10-06T04:19:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4012750 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec016ba20 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4012b10 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec016bfe0 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.130+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec00b2f90 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.131+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faeb401e460 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.131+0000 7faebd7fa700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.131+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7faeb4084ba0 con 0x7faec00b5e30 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.132+0000 7faec5192700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.132+0000 7faec5192700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 0x7faeac0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faeb00099b0 tx=0x7faeb0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.136+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faeb4051c90 con 0x7faec00b5e30 2023-10-06T04:19:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.372+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec0063410 con 0x7faec00b5e30 2023-10-06T04:19:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.372+0000 7faebd7fa700 1 -- 172.21.15.37:0/2331603051 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7faeb40552b0 con 0x7faec00b5e30 2023-10-06T04:19:15.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:15.375 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:19:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 msgr2=0x7faeac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 0x7faeac0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faeb00099b0 tx=0x7faeb0017000 comp rx=0 tx=0).stop 2023-10-06T04:19:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 msgr2=0x7faec00b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d860 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 shutdown_connections 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec00b6200 0x7faec016c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7faeac066f30 0x7faeac0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec00ad0f0 0x7faec009b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 --2- 172.21.15.37:0/2331603051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faec00b5e30 0x7faec00b4850 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.374+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 >> 172.21.15.37:0/2331603051 conn(0x7faec0099a10 msgr2=0x7faec015d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.375+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 shutdown_connections 2023-10-06T04:19:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.375+0000 7faec73f6700 1 -- 172.21.15.37:0/2331603051 wait complete. 2023-10-06T04:19:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:19:15.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:19:15.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.506+0000 7fd748c91700 1 Processor -- start 2023-10-06T04:19:15.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.507+0000 7fd748c91700 1 -- start start 2023-10-06T04:19:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.507+0000 7fd748c91700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 0x7fd7440c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.507+0000 7fd748c91700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7440cc690 0x7fd744069940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.507+0000 7fd748c91700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7440694b0 con 0x7fd74406d810 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd748c91700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd744159ba0 con 0x7fd7440cc690 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd748c91700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440688a0 con 0x7fd7440ca670 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7440cc690 0x7fd744069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd741d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd74406d810 0x7fd7440cbf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53820/0 (socket says 172.21.15.37:53820) 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd741d9b700 1 -- 172.21.15.37:0/3195009269 learned_addr learned my addr 172.21.15.37:0/3195009269 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74259c700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 0x7fd7440c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 -- 172.21.15.37:0/3195009269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 msgr2=0x7fd7440c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 0x7fd7440c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 -- 172.21.15.37:0/3195009269 >> v1:172.21.15.37:6789/0 conn(0x7fd74406d810 legacy=0x7fd7440cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 -- 172.21.15.37:0/3195009269 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744068b80 con 0x7fd7440cc690 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74159a700 1 -- 172.21.15.37:0/3195009269 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234779688 0 0) 0x7fd7440694b0 con 0x7fd74406d810 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74259c700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 0x7fd7440c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd742d9d700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd744069940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0098e0 tx=0x7fd73c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7d09428be4c6f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74159a700 1 -- 172.21.15.37:0/3195009269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c009e80 con 0x7fd7440cc690 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74159a700 1 -- 172.21.15.37:0/3195009269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c00b860 con 0x7fd7440cc690 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.508+0000 7fd74159a700 1 -- 172.21.15.37:0/3195009269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00bbe0 con 0x7fd7440cc690 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 -- 172.21.15.37:0/3195009269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 msgr2=0x7fd744069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd744069940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0098e0 tx=0x7fd73c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 -- 172.21.15.37:0/3195009269 shutdown_connections 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd744069940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 --2- 172.21.15.37:0/3195009269 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7440ca670 0x7fd7440c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 -- 172.21.15.37:0/3195009269 >> 172.21.15.37:0/3195009269 conn(0x7fd7440ce3b0 msgr2=0x7fd7440ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:15.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 -- 172.21.15.37:0/3195009269 shutdown_connections 2023-10-06T04:19:15.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.509+0000 7fd748c91700 1 -- 172.21.15.37:0/3195009269 wait complete. 2023-10-06T04:19:15.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.510+0000 7fd748c91700 1 Processor -- start 2023-10-06T04:19:15.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.510+0000 7fd748c91700 1 -- start start 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd74406d810 0x7fd7440b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 0x7fd7440c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440b2d30 con 0x7fd7440cc690 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440afc90 con 0x7fd7440ca670 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd748c91700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440b2120 con 0x7fd74406d810 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47794/0 (socket says 172.21.15.37:47794) 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 -- 172.21.15.37:0/2210141714 learned_addr learned my addr 172.21.15.37:0/2210141714 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd74259c700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd74406d810 0x7fd7440b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd741d9b700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 0x7fd7440c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 -- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd74406d810 msgr2=0x7fd7440b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd74406d810 0x7fd7440b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 -- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 msgr2=0x7fd7440c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 0x7fd7440c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 -- 172.21.15.37:0/2210141714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c009420 con 0x7fd7440cc690 2023-10-06T04:19:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd741d9b700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 0x7fd7440c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.511+0000 7fd742d9d700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd7440cbf30 tx=0x7fd73c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.512+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00bba0 con 0x7fd7440cc690 2023-10-06T04:19:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.512+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c011630 con 0x7fd7440cc690 2023-10-06T04:19:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.512+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7440b2400 con 0x7fd7440cc690 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.512+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0119f0 con 0x7fd7440cc690 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.512+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7440b29c0 con 0x7fd7440cc690 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.513+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7440b2ea0 con 0x7fd7440cc690 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.513+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd73c02c3b0 con 0x7fd7440cc690 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.513+0000 7fd73a7fc700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.514+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd73c085e30 con 0x7fd7440cc690 2023-10-06T04:19:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.514+0000 7fd74259c700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.514+0000 7fd74259c700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7340094d0 tx=0x7fd73400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.518+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd73c052f20 con 0x7fd7440cc690 2023-10-06T04:19:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.758+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd74404c3c0 con 0x7fd7440cc690 2023-10-06T04:19:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.758+0000 7fd73a7fc700 1 -- 172.21.15.37:0/2210141714 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fd73c056540 con 0x7fd7440cc690 2023-10-06T04:19:15.760 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:15.760 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:17:44.423753+0000","modified":"2023-10-06T04:17:48.038784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2973556572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2973556572},{"type":"v1","addr":"172.21.15.37:6835","nonce":2973556572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 msgr2=0x7fd7240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 0x7fd7240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7340094d0 tx=0x7fd73400b040 comp rx=0 tx=0).stop 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 msgr2=0x7fd7441575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd7440cbf30 tx=0x7fd73c017000 comp rx=0 tx=0).stop 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 shutdown_connections 2023-10-06T04:19:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7440cc690 0x7fd7441575f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd74406d810 0x7fd7440b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fd724066f30 0x7fd7240693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 --2- 172.21.15.37:0/2210141714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7440ca670 0x7fd7440c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 >> 172.21.15.37:0/2210141714 conn(0x7fd7440ce3b0 msgr2=0x7fd7440aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 shutdown_connections 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.760+0000 7fd748c91700 1 -- 172.21.15.37:0/2210141714 wait complete. 2023-10-06T04:19:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-10-06T04:19:15.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:19:15.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.892+0000 7fc5eb8d1700 1 Processor -- start 2023-10-06T04:19:15.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.892+0000 7fc5eb8d1700 1 -- start start 2023-10-06T04:19:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5eb8d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5e41540b0 0x7fc5e4067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5eb8d1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e415a140 con 0x7fc5e40b1070 2023-10-06T04:19:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5eb8d1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e415afa0 con 0x7fc5e406e7a0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5eb8d1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40b1490 con 0x7fc5e41540b0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5e966d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5e41540b0 0x7fc5e4067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5e9e6e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5e40b1070 0x7fc5e40cd2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53826/0 (socket says 172.21.15.37:53826) 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.893+0000 7fc5e9e6e700 1 -- 172.21.15.37:0/2579435262 learned_addr learned my addr 172.21.15.37:0/2579435262 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e966d700 1 -- 172.21.15.37:0/2579435262 >> v1:172.21.15.83:6789/0 conn(0x7fc5e406e7a0 legacy=0x7fc5e40b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e966d700 1 -- 172.21.15.37:0/2579435262 >> v1:172.21.15.37:6789/0 conn(0x7fc5e40b1070 legacy=0x7fc5e40cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e3fff700 1 -- 172.21.15.37:0/2579435262 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608281245 0 0) 0x7fc5e415a140 con 0x7fc5e40b1070 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e966d700 1 -- 172.21.15.37:0/2579435262 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e415a390 con 0x7fc5e41540b0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e966d700 1 --2- 172.21.15.37:0/2579435262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e41540b0 0x7fc5e4067660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009e60 tx=0x7fc5d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c02a0aad0fb46ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e3fff700 1 -- 172.21.15.37:0/2579435262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400e070 con 0x7fc5e41540b0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e3fff700 1 -- 172.21.15.37:0/2579435262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d400bbf0 con 0x7fc5e41540b0 2023-10-06T04:19:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5e3fff700 1 -- 172.21.15.37:0/2579435262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4012430 con 0x7fc5e41540b0 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/2579435262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e41540b0 msgr2=0x7fc5e4067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.894+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/2579435262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e41540b0 0x7fc5e4067660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009e60 tx=0x7fc5d4009780 comp rx=0 tx=0).stop 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.895+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/2579435262 shutdown_connections 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.895+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/2579435262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e41540b0 0x7fc5e4067660 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.895+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/2579435262 >> 172.21.15.37:0/2579435262 conn(0x7fc5e4068770 msgr2=0x7fc5e4068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.895+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/2579435262 shutdown_connections 2023-10-06T04:19:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.895+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/2579435262 wait complete. 2023-10-06T04:19:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.896+0000 7fc5eb8d1700 1 Processor -- start 2023-10-06T04:19:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.896+0000 7fc5eb8d1700 1 -- start start 2023-10-06T04:19:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5e40b1070 0x7fc5e4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5e41540b0 0x7fc5e4156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4157640 con 0x7fc5e406e7a0 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4156a30 con 0x7fc5e40b1070 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4156d10 con 0x7fc5e41540b0 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47806/0 (socket says 172.21.15.37:47806) 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 -- 172.21.15.37:0/1532292521 learned_addr learned my addr 172.21.15.37:0/1532292521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e8e6c700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5e40b1070 0x7fc5e4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e9e6e700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5e41540b0 0x7fc5e4156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 -- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5e41540b0 msgr2=0x7fc5e4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5e41540b0 0x7fc5e4156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 -- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5e40b1070 msgr2=0x7fc5e4155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5e40b1070 0x7fc5e4155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 -- 172.21.15.37:0/1532292521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4009a20 con 0x7fc5e406e7a0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e966d700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400b6c0 tx=0x7fc5d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4027470 con 0x7fc5e406e7a0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40275f0 con 0x7fc5e406e7a0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40279b0 con 0x7fc5e406e7a0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4156ff0 con 0x7fc5e406e7a0 2023-10-06T04:19:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.897+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4157ad0 con 0x7fc5e406e7a0 2023-10-06T04:19:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.898+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e4063410 con 0x7fc5e406e7a0 2023-10-06T04:19:15.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.899+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5d4024070 con 0x7fc5e406e7a0 2023-10-06T04:19:15.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.899+0000 7fc5e17fa700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:15.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.899+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc5d4087290 con 0x7fc5e406e7a0 2023-10-06T04:19:15.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.899+0000 7fc5e8e6c700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:15.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.900+0000 7fc5e8e6c700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 0x7fc5d00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5e416d870 tx=0x7fc5d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:15.903+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5d4054380 con 0x7fc5e406e7a0 2023-10-06T04:19:16.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.098+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5e415a670 con 0x7fc5e406e7a0 2023-10-06T04:19:16.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.099+0000 7fc5e17fa700 1 -- 172.21.15.37:0/1532292521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fc5d40579a0 con 0x7fc5e406e7a0 2023-10-06T04:19:16.101 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:16.101 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:18:37.756218+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:17:42.697839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:17:43.387985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.4","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 msgr2=0x7fc5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 0x7fc5d00693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc5e416d870 tx=0x7fc5d8009040 comp rx=0 tx=0).stop 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 msgr2=0x7fc5e413aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400b6c0 tx=0x7fc5d4018000 comp rx=0 tx=0).stop 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 shutdown_connections 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc5e41540b0 0x7fc5e4156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5e406e7a0 0x7fc5e413aeb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc5d0066f30 0x7fc5d00693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 --2- 172.21.15.37:0/1532292521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5e40b1070 0x7fc5e4155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 >> 172.21.15.37:0/1532292521 conn(0x7fc5e4068770 msgr2=0x7fc5e4152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 shutdown_connections 2023-10-06T04:19:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.101+0000 7fc5eb8d1700 1 -- 172.21.15.37:0/1532292521 wait complete. 2023-10-06T04:19:16.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:19:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.234+0000 7eff33e9e700 1 Processor -- start 2023-10-06T04:19:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.234+0000 7eff33e9e700 1 -- start start 2023-10-06T04:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff33e9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff33e9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff2c0ccb80 0x7eff2c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff33e9e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c0c9730 con 0x7eff2c157710 2023-10-06T04:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff33e9e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c15e4a0 con 0x7eff2c0ccb80 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff33e9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c8e00 con 0x7eff2c157340 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff31c3a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff31c3a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:59450/0 (socket says 172.21.15.37:59450) 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff31c3a700 1 -- 172.21.15.37:0/3624872042 learned_addr learned my addr 172.21.15.37:0/3624872042 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.235+0000 7eff3243b700 1 --2- 172.21.15.37:0/3624872042 >> v2:172.21.15.83:3300/0 conn(0x7eff2c0ccb80 0x7eff2c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff30c38700 1 -- 172.21.15.37:0/3624872042 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374624290 0 0) 0x7eff2c0c9730 con 0x7eff2c157710 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff31c3a700 1 -- 172.21.15.37:0/3624872042 >> v2:172.21.15.83:3300/0 conn(0x7eff2c0ccb80 msgr2=0x7eff2c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff31c3a700 1 --2- 172.21.15.37:0/3624872042 >> v2:172.21.15.83:3300/0 conn(0x7eff2c0ccb80 0x7eff2c15d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff31c3a700 1 -- 172.21.15.37:0/3624872042 >> v1:172.21.15.83:6789/0 conn(0x7eff2c157710 legacy=0x7eff2c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff31c3a700 1 -- 172.21.15.37:0/3624872042 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0c90e0 con 0x7eff2c157340 2023-10-06T04:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff31c3a700 1 --2- 172.21.15.37:0/3624872042 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009f70 tx=0x7eff1c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd321df755f8413 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff30c38700 1 -- 172.21.15.37:0/3624872042 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00e070 con 0x7eff2c157340 2023-10-06T04:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff30c38700 1 -- 172.21.15.37:0/3624872042 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00ba20 con 0x7eff2c157340 2023-10-06T04:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff30c38700 1 -- 172.21.15.37:0/3624872042 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0092e0 con 0x7eff2c157340 2023-10-06T04:19:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 -- 172.21.15.37:0/3624872042 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 msgr2=0x7eff2c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 --2- 172.21.15.37:0/3624872042 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009f70 tx=0x7eff1c009840 comp rx=0 tx=0).stop 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 -- 172.21.15.37:0/3624872042 shutdown_connections 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 --2- 172.21.15.37:0/3624872042 >> v2:172.21.15.83:3300/0 conn(0x7eff2c0ccb80 0x7eff2c15d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 --2- 172.21.15.37:0/3624872042 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c157340 0x7eff2c0c9bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.236+0000 7eff33e9e700 1 -- 172.21.15.37:0/3624872042 >> 172.21.15.37:0/3624872042 conn(0x7eff2c06baa0 msgr2=0x7eff2c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.237+0000 7eff33e9e700 1 -- 172.21.15.37:0/3624872042 shutdown_connections 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.237+0000 7eff33e9e700 1 -- 172.21.15.37:0/3624872042 wait complete. 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 Processor -- start 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 -- start start 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c0ccb80 0x7eff2c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2c157340 0x7eff2c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1595e0 con 0x7eff2c157710 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1598c0 con 0x7eff2c157340 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.238+0000 7eff33e9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c6ca0 con 0x7eff2c0ccb80 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47812/0 (socket says 172.21.15.37:47812) 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 -- 172.21.15.37:0/2408387591 learned_addr learned my addr 172.21.15.37:0/2408387591 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff31c3a700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c0ccb80 0x7eff2c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff31439700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2c157340 0x7eff2c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 -- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c0ccb80 msgr2=0x7eff2c15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c0ccb80 0x7eff2c15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 -- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2c157340 msgr2=0x7eff2c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2c157340 0x7eff2c154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 -- 172.21.15.37:0/2408387591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009ae0 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff3243b700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff2400ea20 tx=0x7eff240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24009650 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2400c7f0 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c0c6f80 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.239+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2400cbb0 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.240+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0c6950 con 0x7eff2c157710 2023-10-06T04:19:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.240+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c063410 con 0x7eff2c157710 2023-10-06T04:19:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.241+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff24013470 con 0x7eff2c157710 2023-10-06T04:19:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.241+0000 7eff29ffb700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 0x7eff180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.241+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6087+0+0 (secure 0 0 0) 0x7eff24084850 con 0x7eff2c157710 2023-10-06T04:19:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.241+0000 7eff31c3a700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 0x7eff180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.242+0000 7eff31c3a700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 0x7eff180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009880 tx=0x7eff1c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.245+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff240518a0 con 0x7eff2c157710 2023-10-06T04:19:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.480+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7eff2c0c71c0 con 0x7eff2c157710 2023-10-06T04:19:16.482 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T04:19:16.481+0000 7f8a6e8c5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:19:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.486+0000 7eff29ffb700 1 -- 172.21.15.37:0/2408387591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7eff2c0c71c0 con 0x7eff2c157710 2023-10-06T04:19:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 msgr2=0x7eff180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 0x7eff180693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009880 tx=0x7eff1c018000 comp rx=0 tx=0).stop 2023-10-06T04:19:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 msgr2=0x7eff2c158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff2400ea20 tx=0x7eff240091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 shutdown_connections 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff2c157710 0x7eff2c158a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff2c0ccb80 0x7eff2c15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7eff18066f30 0x7eff180693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 --2- 172.21.15.37:0/2408387591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2c157340 0x7eff2c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 >> 172.21.15.37:0/2408387591 conn(0x7eff2c06baa0 msgr2=0x7eff2c0ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 shutdown_connections 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.488+0000 7eff33e9e700 1 -- 172.21.15.37:0/2408387591 wait complete. 2023-10-06T04:19:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:19:16.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:19:16.521 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T04:19:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.624+0000 7f0dd6d57700 1 Processor -- start 2023-10-06T04:19:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.624+0000 7f0dd6d57700 1 -- start start 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6d57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 0x7f0dd00aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6d57700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd00b0b20 con 0x7f0dd0068670 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6d57700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd00aff10 con 0x7f0dd01596a0 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6d57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd00b01f0 con 0x7f0dd01592d0 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6556700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0dd0068670 0x7f0dd00b0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37888/0 (socket says 172.21.15.37:37888) 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd6556700 1 -- 172.21.15.37:0/603044328 learned_addr learned my addr 172.21.15.37:0/603044328 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.625+0000 7f0dd5d55700 1 --2- 172.21.15.37:0/603044328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 0x7f0dd00aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084983028 0 0) 0x7f0dd00b0b20 con 0x7f0dd0068670 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db8003570 con 0x7f0dd0068670 2023-10-06T04:19:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293656407 0 0) 0x7f0dd00aff10 con 0x7f0dd01596a0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00b0b20 con 0x7f0dd01596a0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd5d55700 1 -- 172.21.15.37:0/603044328 >> v1:172.21.15.83:6789/0 conn(0x7f0dd01596a0 legacy=0x7f0dd00af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd5d55700 1 -- 172.21.15.37:0/603044328 >> v1:172.21.15.37:6789/0 conn(0x7f0dd0068670 legacy=0x7f0dd00b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd5d55700 1 -- 172.21.15.37:0/603044328 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00b04d0 con 0x7f0dd01592d0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd5d55700 1 --2- 172.21.15.37:0/603044328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 0x7f0dd00aed70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009e90 tx=0x7f0dc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8075262d149f81c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000e070 con 0x7f0dd01592d0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000bb80 con 0x7f0dd01592d0 2023-10-06T04:19:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.626+0000 7f0dd4d53700 1 -- 172.21.15.37:0/603044328 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0012430 con 0x7f0dd01592d0 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 -- 172.21.15.37:0/603044328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 msgr2=0x7f0dd00aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/603044328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 0x7f0dd00aed70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009e90 tx=0x7f0dc0009780 comp rx=0 tx=0).stop 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 -- 172.21.15.37:0/603044328 shutdown_connections 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/603044328 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd01592d0 0x7f0dd00aed70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 -- 172.21.15.37:0/603044328 >> 172.21.15.37:0/603044328 conn(0x7f0dd006dd80 msgr2=0x7f0dd006e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 -- 172.21.15.37:0/603044328 shutdown_connections 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.627+0000 7f0dd6d57700 1 -- 172.21.15.37:0/603044328 wait complete. 2023-10-06T04:19:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.628+0000 7f0dd6d57700 1 Processor -- start 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.628+0000 7f0dd6d57700 1 -- start start 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd0068670 0x7f0dd0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01592d0 0x7f0dd01565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd016a7b0 con 0x7f0dd01596a0 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0150ef0 con 0x7f0dd01592d0 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6d57700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0169ba0 con 0x7f0dd0068670 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60274/0 (socket says 172.21.15.37:60274) 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 -- 172.21.15.37:0/1550443 learned_addr learned my addr 172.21.15.37:0/1550443 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd5d55700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd0068670 0x7f0dd0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd5554700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01592d0 0x7f0dd01565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 -- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd0068670 msgr2=0x7f0dd0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd0068670 0x7f0dd0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 -- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01592d0 msgr2=0x7f0dd01565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01592d0 0x7f0dd01565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.629+0000 7f0dd6556700 1 -- 172.21.15.37:0/1550443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0009a20 con 0x7f0dd01596a0 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dd6556700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c560 tx=0x7f0dc8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8005c00 con 0x7f0dd01596a0 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8005d80 con 0x7f0dd01596a0 2023-10-06T04:19:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd0169e80 con 0x7f0dd01596a0 2023-10-06T04:19:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8007320 con 0x7f0dd01596a0 2023-10-06T04:19:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.630+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd016a440 con 0x7f0dd01596a0 2023-10-06T04:19:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.631+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd00aaa20 con 0x7f0dd01596a0 2023-10-06T04:19:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.631+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dc8007690 con 0x7f0dd01596a0 2023-10-06T04:19:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.632+0000 7f0dcdffb700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.632+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f0dc8083bf0 con 0x7f0dd01596a0 2023-10-06T04:19:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.632+0000 7f0dd5d55700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.632+0000 7f0dd5d55700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00097c0 tx=0x7f0dc0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.636+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dc8050c90 con 0x7f0dd01596a0 2023-10-06T04:19:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:16.875+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0dd004c3c0 con 0x7f0dd01596a0 2023-10-06T04:19:17.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.485+0000 7f0dcdffb700 1 -- 172.21.15.37:0/1550443 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0dc8017020 con 0x7f0dd01596a0 2023-10-06T04:19:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 msgr2=0x7f0dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00097c0 tx=0x7f0dc0019000 comp rx=0 tx=0).stop 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 msgr2=0x7f0dd0159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c560 tx=0x7f0dc8007dd0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 shutdown_connections 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd01596a0 0x7f0dd0159bc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0dd0068670 0x7f0dd0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 --2- 172.21.15.37:0/1550443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0dd01592d0 0x7f0dd01565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 >> 172.21.15.37:0/1550443 conn(0x7f0dd006dd80 msgr2=0x7f0dd00a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 shutdown_connections 2023-10-06T04:19:17.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.488+0000 7f0dd6d57700 1 -- 172.21.15.37:0/1550443 wait complete. 2023-10-06T04:19:17.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:19:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.669+0000 7f1a14c86700 1 Processor -- start 2023-10-06T04:19:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.669+0000 7f1a14c86700 1 -- start start 2023-10-06T04:19:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 0x7f1a1015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a1015e280 0x7f1a10159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015a2e0 0x7f1a100c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1015d8b0 con 0x7f1a1015e280 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1015a800 con 0x7f1a101599d0 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a14c86700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1015aae0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a0dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a1015e280 0x7f1a10159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a0dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a1015e280 0x7f1a10159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60278/0 (socket says 172.21.15.37:60278) 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.670+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3968275768 learned_addr learned my addr 172.21.15.37:0/3968275768 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0e59c700 1 --2- 172.21.15.37:0/3968275768 >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 0x7f1a1015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3968275768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015a2e0 msgr2=0x7f1a100c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3968275768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015a2e0 0x7f1a100c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3968275768 >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 msgr2=0x7f1a1015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3968275768 >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 0x7f1a1015dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3968275768 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1015adc0 con 0x7f1a1015e280 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0e59c700 1 --2- 172.21.15.37:0/3968275768 >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 0x7f1a1015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3968275768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015e280 0x7f1a10159da0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006efe0 tx=0x7f19f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce4f6028461c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0d59a700 1 -- 172.21.15.37:0/3968275768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800b860 con 0x7f1a1015e280 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0d59a700 1 -- 172.21.15.37:0/3968275768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f800b9c0 con 0x7f1a1015e280 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a0d59a700 1 -- 172.21.15.37:0/3968275768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800bd60 con 0x7f1a1015e280 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a14c86700 1 -- 172.21.15.37:0/3968275768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015e280 msgr2=0x7f1a10159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.671+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3968275768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015e280 0x7f1a10159da0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006efe0 tx=0x7f19f8009250 comp rx=0 tx=0).stop 2023-10-06T04:19:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 -- 172.21.15.37:0/3968275768 shutdown_connections 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3968275768 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015a2e0 0x7f1a100c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3968275768 >> v2:172.21.15.83:3300/0 conn(0x7f1a101599d0 0x7f1a1015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3968275768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015e280 0x7f1a10159da0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 -- 172.21.15.37:0/3968275768 >> 172.21.15.37:0/3968275768 conn(0x7f1a100ce430 msgr2=0x7f1a100ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 -- 172.21.15.37:0/3968275768 shutdown_connections 2023-10-06T04:19:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.672+0000 7f1a14c86700 1 -- 172.21.15.37:0/3968275768 wait complete. 2023-10-06T04:19:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 Processor -- start 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 -- start start 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a101599d0 0x7f1a100c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015e280 0x7f1a1015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100c4f70 con 0x7f1a1015a2e0 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100c4ae0 con 0x7f1a101599d0 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.673+0000 7f1a14c86700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100c3c30 con 0x7f1a1015e280 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60280/0 (socket says 172.21.15.37:60280) 2023-10-06T04:19:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3454683655 learned_addr learned my addr 172.21.15.37:0/3454683655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0e59c700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a101599d0 0x7f1a100c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0ed9d700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015e280 0x7f1a1015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015e280 msgr2=0x7f1a1015c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015e280 0x7f1a1015c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a101599d0 msgr2=0x7f1a100c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a101599d0 0x7f1a100c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 -- 172.21.15.37:0/3454683655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80094f0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a0dd9b700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009290 tx=0x7f19f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8011e40 con 0x7f1a1015a2e0 2023-10-06T04:19:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f801a450 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a100c3ed0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f801a810 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.674+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a100c4490 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.675+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a100c4dc0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.676+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19f801abc0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.676+0000 7f1a067fc700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 0x7f19f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.676+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f19f8085ce0 con 0x7f1a1015a2e0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.676+0000 7f1a0e59c700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 0x7f19f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.677+0000 7f1a0e59c700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 0x7f19f00693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a08006fd0 tx=0x7f1a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.680+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19f8052d80 con 0x7f1a1015a2e0 2023-10-06T04:19:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:17.873+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a1004c3c0 con 0x7f1a1015a2e0 2023-10-06T04:19:18.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.835+0000 7f1a067fc700 1 -- 172.21.15.37:0/3454683655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f19f80200d0 con 0x7f1a1015a2e0 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 msgr2=0x7f19f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 0x7f19f00693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a08006fd0 tx=0x7f1a08008040 comp rx=0 tx=0).stop 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 msgr2=0x7f1a1015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009290 tx=0x7f19f8017000 comp rx=0 tx=0).stop 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 shutdown_connections 2023-10-06T04:19:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1a1015e280 0x7f1a1015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f19f0066f30 0x7f19f00693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1a101599d0 0x7f1a100c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 --2- 172.21.15.37:0/3454683655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a1015a2e0 0x7f1a1015c400 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.839+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 >> 172.21.15.37:0/3454683655 conn(0x7f1a100ce430 msgr2=0x7f1a100cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.840+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 shutdown_connections 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.840+0000 7f1a14c86700 1 -- 172.21.15.37:0/3454683655 wait complete. 2023-10-06T04:19:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:19:18.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:19:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.993+0000 7f4bb2769700 1 Processor -- start 2023-10-06T04:19:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.993+0000 7f4bb2769700 1 -- start start 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4bac15ab20 0x7f4bac0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac15a0a0 0x7f4bac0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac0cd320 0x7f4bac0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0ce130 con 0x7f4bac0cd320 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0cb6b0 con 0x7f4bac15ab20 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb2769700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0cb990 con 0x7f4bac15a0a0 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac0cd320 0x7f4bac0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac0cd320 0x7f4bac0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60286/0 (socket says 172.21.15.37:60286) 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 -- 172.21.15.37:0/1086255495 learned_addr learned my addr 172.21.15.37:0/1086255495 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac15a0a0 0x7f4bac0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4babfff700 1 --2- 172.21.15.37:0/1086255495 >> v2:172.21.15.83:3300/0 conn(0x7f4bac15ab20 0x7f4bac0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 -- 172.21.15.37:0/1086255495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac15a0a0 msgr2=0x7f4bac0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac15a0a0 0x7f4bac0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 -- 172.21.15.37:0/1086255495 >> v2:172.21.15.83:3300/0 conn(0x7f4bac15ab20 msgr2=0x7f4bac0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 --2- 172.21.15.37:0/1086255495 >> v2:172.21.15.83:3300/0 conn(0x7f4bac15ab20 0x7f4bac0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 -- 172.21.15.37:0/1086255495 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0cbc70 con 0x7f4bac0cd320 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4bb0d06700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0cd320 0x7f4bac0ce5c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bac089820 tx=0x7f4ba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2bf3c318724102 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.994+0000 7f4baaffd700 1 -- 172.21.15.37:0/1086255495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x7f4bac0cd320 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4baaffd700 1 -- 172.21.15.37:0/1086255495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400b970 con 0x7f4bac0cd320 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4baaffd700 1 -- 172.21.15.37:0/1086255495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40092e0 con 0x7f4bac0cd320 2023-10-06T04:19:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 -- 172.21.15.37:0/1086255495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0cd320 msgr2=0x7f4bac0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0cd320 0x7f4bac0ce5c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bac089820 tx=0x7f4ba4009840 comp rx=0 tx=0).stop 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 -- 172.21.15.37:0/1086255495 shutdown_connections 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0cd320 0x7f4bac0ce5c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 --2- 172.21.15.37:0/1086255495 >> v2:172.21.15.83:3300/0 conn(0x7f4bac15ab20 0x7f4bac0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 --2- 172.21.15.37:0/1086255495 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac15a0a0 0x7f4bac0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 -- 172.21.15.37:0/1086255495 >> 172.21.15.37:0/1086255495 conn(0x7f4bac099990 msgr2=0x7f4bac06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 -- 172.21.15.37:0/1086255495 shutdown_connections 2023-10-06T04:19:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.995+0000 7f4bb2769700 1 -- 172.21.15.37:0/1086255495 wait complete. 2023-10-06T04:19:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.996+0000 7f4bb2769700 1 Processor -- start 2023-10-06T04:19:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.996+0000 7f4bb2769700 1 -- start start 2023-10-06T04:19:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac0cd320 0x7f4bac146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 0x7f4bac069e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac147440 con 0x7f4bac15a0a0 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09d710 con 0x7f4bac15ab20 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb2769700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09dba0 con 0x7f4bac0cd320 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60288/0 (socket says 172.21.15.37:60288) 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 -- 172.21.15.37:0/2043374667 learned_addr learned my addr 172.21.15.37:0/2043374667 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4babfff700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac0cd320 0x7f4bac146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bb0d06700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 0x7f4bac069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 -- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac0cd320 msgr2=0x7f4bac146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac0cd320 0x7f4bac146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 -- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 msgr2=0x7f4bac069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.997+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 0x7f4bac069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4bab7fe700 1 -- 172.21.15.37:0/2043374667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009ae0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4bb0d06700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 0x7f4bac069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e950 tx=0x7f4b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c013680 con 0x7f4bac15a0a0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0137e0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac09cb00 con 0x7f4bac15a0a0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c013ba0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.998+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac09d0c0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.999+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac09d880 con 0x7f4bac15a0a0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:18.999+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b9c00c490 con 0x7f4bac15a0a0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.000+0000 7f4ba3fff700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 0x7f4b8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.000+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5735+0+0 (secure 0 0 0) 0x7f4b9c084670 con 0x7f4bac15a0a0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.000+0000 7f4babfff700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 0x7f4b8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.001+0000 7f4babfff700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 0x7f4b8c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4bac09b020 tx=0x7f4b940091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.004+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b9c0518c0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.195+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bac04c3c0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.850+0000 7f4ba3fff700 1 -- 172.21.15.37:0/2043374667 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4b9c054ee0 con 0x7f4bac15a0a0 2023-10-06T04:19:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 msgr2=0x7f4b8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 0x7f4b8c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4bac09b020 tx=0x7f4b940091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 msgr2=0x7f4bac069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00e950 tx=0x7f4b9c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 shutdown_connections 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f4b8c066f30 0x7f4b8c0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bac15ab20 0x7f4bac069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bac0cd320 0x7f4bac146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 --2- 172.21.15.37:0/2043374667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a0a0 0x7f4bac069930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 >> 172.21.15.37:0/2043374667 conn(0x7f4bac099990 msgr2=0x7f4bac153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.854+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 shutdown_connections 2023-10-06T04:19:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.855+0000 7f4bb2769700 1 -- 172.21.15.37:0/2043374667 wait complete. 2023-10-06T04:19:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T04:19:19.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:19:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.995+0000 7f9ab18b1700 1 Processor -- start 2023-10-06T04:19:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.995+0000 7f9ab18b1700 1 -- start start 2023-10-06T04:19:19.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9ab18b1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9aac0cd0b0 0x7f9aac15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9ab18b1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd480 0x7f9aac0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9ab18b1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0cb8d0 con 0x7f9aac0afed0 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9ab18b1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0ce7c0 con 0x7f9aac0cd0b0 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9ab18b1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0ceaa0 con 0x7f9aac0cd480 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aab7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9aac0afed0 0x7f9aac0b1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37904/0 (socket says 172.21.15.37:37904) 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aab7fe700 1 -- 172.21.15.37:0/2370004821 learned_addr learned my addr 172.21.15.37:0/2370004821 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2370004821 >> v2:172.21.15.83:3300/0 conn(0x7f9aac0cd0b0 0x7f9aac15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aaa7fc700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd480 0x7f9aac0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018032706 0 0) 0x7f9aac0cb8d0 con 0x7f9aac0afed0 2023-10-06T04:19:19.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.996+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a98003570 con 0x7f9aac0afed0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aaaffd700 1 -- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd480 msgr2=0x7f9aac0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd480 0x7f9aac0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aaaffd700 1 -- 172.21.15.37:0/2370004821 >> v1:172.21.15.37:6789/0 conn(0x7f9aac0afed0 legacy=0x7f9aac0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895918722 0 0) 0x7f9a98003570 con 0x7f9aac0afed0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aaaffd700 1 -- 172.21.15.37:0/2370004821 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0ced80 con 0x7f9aac0cd0b0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0cd0b0 0x7f9aac15dd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009e60 tx=0x7f9a9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efff32cdf6c7e1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00e070 con 0x7f9aac0cd0b0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00b830 con 0x7f9aac0cd0b0 2023-10-06T04:19:20.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.997+0000 7f9aa9ffb700 1 -- 172.21.15.37:0/2370004821 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4001470 con 0x7f9aac0cd0b0 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0cd0b0 msgr2=0x7f9aac15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0cd0b0 0x7f9aac15dd50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009e60 tx=0x7f9a9c009780 comp rx=0 tx=0).stop 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2370004821 shutdown_connections 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0cd0b0 0x7f9aac15dd50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2370004821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd480 0x7f9aac0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2370004821 >> 172.21.15.37:0/2370004821 conn(0x7f9aac06ed90 msgr2=0x7f9aac06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2370004821 shutdown_connections 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.998+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2370004821 wait complete. 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.999+0000 7f9ab18b1700 1 Processor -- start 2023-10-06T04:19:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:19.999+0000 7f9ab18b1700 1 -- start start 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 0x7f9aac0c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 0x7f9aac155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0c64b0 con 0x7f9aac0cd480 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac155e50 con 0x7f9aac0afed0 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac15a960 con 0x7f9aac0cd0b0 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60302/0 (socket says 172.21.15.37:60302) 2023-10-06T04:19:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 -- 172.21.15.37:0/2380853029 learned_addr learned my addr 172.21.15.37:0/2380853029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aaa7fc700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 0x7f9aac155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 0x7f9aac0c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 -- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 msgr2=0x7f9aac155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 0x7f9aac155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 -- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 msgr2=0x7f9aac0c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 0x7f9aac0c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 -- 172.21.15.37:0/2380853029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009a20 con 0x7f9aac0cd480 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 0x7f9aac0c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aaa7fc700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 0x7f9aac155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aab7fe700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400cb60 tx=0x7f9aa4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4001d30 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4007360 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac0c5e60 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.000+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4004830 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.001+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac15ac40 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.001+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac04c3c0 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.002+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa4004be0 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.002+0000 7f9aa2ffd700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.002+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9aa4083bc0 con 0x7f9aac0cd480 2023-10-06T04:19:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.002+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.003+0000 7f9aaaffd700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 0x7f9a8c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0099f0 tx=0x7f9a9c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.007+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa4050fb0 con 0x7f9aac0cd480 2023-10-06T04:19:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.209+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9aac0cf060 con 0x7f9aac0cd480 2023-10-06T04:19:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.213+0000 7f9aa2ffd700 1 -- 172.21.15.37:0/2380853029 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9aa40545d0 con 0x7f9aac0cd480 2023-10-06T04:19:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 msgr2=0x7f9a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 0x7f9a8c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0099f0 tx=0x7f9a9c018000 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 msgr2=0x7f9aac0ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400cb60 tx=0x7f9aa4001aa0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 shutdown_connections 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aac0cd480 0x7f9aac0ca240 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9a8c066f30 0x7f9a8c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9aac0afed0 0x7f9aac0c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 --2- 172.21.15.37:0/2380853029 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9aac0cd0b0 0x7f9aac155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 >> 172.21.15.37:0/2380853029 conn(0x7f9aac06ed90 msgr2=0x7f9aac15d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 shutdown_connections 2023-10-06T04:19:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.215+0000 7f9ab18b1700 1 -- 172.21.15.37:0/2380853029 wait complete. 2023-10-06T04:19:20.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T04:19:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.346+0000 7f8deb0a8700 1 Processor -- start 2023-10-06T04:19:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.346+0000 7f8deb0a8700 1 -- start start 2023-10-06T04:19:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8deb0a8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8deb0a8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 0x7f8de40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8deb0a8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40cf460 con 0x7f8de40cb470 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8deb0a8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de40cfe30 con 0x7f8de40ccb90 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8deb0a8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de4159b20 con 0x7f8de40b2810 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8dea0a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8dea0a6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.37:51840/0 (socket says 172.21.15.37:51840) 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.347+0000 7f8dea8a7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 0x7f8de40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 -- 172.21.15.37:0/2953037805 learned_addr learned my addr 172.21.15.37:0/2953037805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 -- 172.21.15.37:0/2953037805 >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 msgr2=0x7f8de40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 --2- 172.21.15.37:0/2953037805 >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 0x7f8de40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 -- 172.21.15.37:0/2953037805 >> v1:172.21.15.83:6789/0 conn(0x7f8de40cb470 legacy=0x7f8de415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 -- 172.21.15.37:0/2953037805 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40ce890 con 0x7f8de40b2810 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea8a7700 1 --2- 172.21.15.37:0/2953037805 >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 0x7f8de40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8de90a4700 1 -- 172.21.15.37:0/2953037805 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199214774 0 0) 0x7f8de40cf460 con 0x7f8de40cb470 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8dea0a6700 1 --2- 172.21.15.37:0/2953037805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f20 tx=0x7f8dd4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=683b89c818b8def9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8de90a4700 1 -- 172.21.15.37:0/2953037805 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400e070 con 0x7f8de40b2810 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8de90a4700 1 -- 172.21.15.37:0/2953037805 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd400b9d0 con 0x7f8de40b2810 2023-10-06T04:19:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.348+0000 7f8de90a4700 1 -- 172.21.15.37:0/2953037805 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40092e0 con 0x7f8de40b2810 2023-10-06T04:19:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 -- 172.21.15.37:0/2953037805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 msgr2=0x7f8de40cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/2953037805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f20 tx=0x7f8dd4009840 comp rx=0 tx=0).stop 2023-10-06T04:19:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 -- 172.21.15.37:0/2953037805 shutdown_connections 2023-10-06T04:19:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/2953037805 >> v2:172.21.15.83:3300/0 conn(0x7f8de40ccb90 0x7f8de40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/2953037805 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de40cf8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 -- 172.21.15.37:0/2953037805 >> 172.21.15.37:0/2953037805 conn(0x7f8de406ed90 msgr2=0x7f8de406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 -- 172.21.15.37:0/2953037805 shutdown_connections 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.349+0000 7f8deb0a8700 1 -- 172.21.15.37:0/2953037805 wait complete. 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.350+0000 7f8deb0a8700 1 Processor -- start 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.350+0000 7f8deb0a8700 1 -- start start 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de41512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 0x7f8de40d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de4151e30 con 0x7f8de40ccb90 2023-10-06T04:19:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b4fd0 con 0x7f8de40cb470 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b4730 con 0x7f8de40b2810 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60310/0 (socket says 172.21.15.37:60310) 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 -- 172.21.15.37:0/72745663 learned_addr learned my addr 172.21.15.37:0/72745663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea0a6700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de41512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8de98a5700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 0x7f8de40d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 -- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 msgr2=0x7f8de41512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de41512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 -- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 msgr2=0x7f8de40d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 0x7f8de40d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 -- 172.21.15.37:0/72745663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009420 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8de98a5700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 0x7f8de40d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8dea8a7700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00ea20 tx=0x7f8ddc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc009680 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc00c850 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd4009ae0 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.351+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00cc10 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.352+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de40b4cf0 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.352+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4151c00 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.353+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ddc013470 con 0x7f8de40ccb90 2023-10-06T04:19:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.353+0000 7f8de27fc700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 0x7f8dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.353+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8ddc084380 con 0x7f8de40ccb90 2023-10-06T04:19:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.353+0000 7f8dea0a6700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 0x7f8dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.354+0000 7f8dea0a6700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 0x7f8dd00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009880 tx=0x7f8dd4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.357+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de4151c00 con 0x7f8de40ccb90 2023-10-06T04:19:20.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.629+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f8de4151c00 con 0x7f8de40ccb90 2023-10-06T04:19:20.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.846+0000 7f8de27fc700 1 -- 172.21.15.37:0/72745663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v128) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8de4151c00 con 0x7f8de40ccb90 2023-10-06T04:19:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 msgr2=0x7f8dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 0x7f8dd00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009880 tx=0x7f8dd4018000 comp rx=0 tx=0).stop 2023-10-06T04:19:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 msgr2=0x7f8de40d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00ea20 tx=0x7f8ddc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 shutdown_connections 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de40ccb90 0x7f8de40d09b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8de40b2810 0x7f8de41512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8dd0066f30 0x7f8dd00693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 --2- 172.21.15.37:0/72745663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de40cb470 0x7f8de40d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.848+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 >> 172.21.15.37:0/72745663 conn(0x7f8de406ed90 msgr2=0x7f8de4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.849+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 shutdown_connections 2023-10-06T04:19:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:20.849+0000 7f8deb0a8700 1 -- 172.21.15.37:0/72745663 wait complete. 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner: 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner:Ran 1 test in 112.446s 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner: 2023-10-06T04:19:20.863 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:19:20.864 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:19:20.873 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:19:20.889 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:19:20.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:20.890 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:19:20.906 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:19:20.907 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:19:20.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:20.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:19:20.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:20.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:19:21.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:19:21.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.160 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T04:19:21.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T04:19:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-10-06T04:19:21.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:21.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.247 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:19:21.266 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:19:21.266 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:19:21.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.267 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:19:21.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:19:21.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.410 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:19:21.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.475 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-10-06T04:19:21.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:19:21.492 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-10-06T04:19:21.561 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-10-06T04:19:21.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:21.562 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:19:21.574 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:19:21.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:19:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.695+0000 7fa49c5c5700 1 Processor -- start 2023-10-06T04:19:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.695+0000 7fa49c5c5700 1 -- start start 2023-10-06T04:19:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49c5c5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa49406f600 0x7fa49414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49c5c5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa494150330 0x7fa494157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49c5c5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4941507b0 con 0x7fa49406f230 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49c5c5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940a9590 con 0x7fa494150330 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49c5c5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940a9860 con 0x7fa49406f600 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49ab62700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa494150330 0x7fa494157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49ab62700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa494150330 0x7fa494157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60314/0 (socket says 172.21.15.37:60314) 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa49ab62700 1 -- 172.21.15.37:0/3460284802 learned_addr learned my addr 172.21.15.37:0/3460284802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.696+0000 7fa499b60700 1 --2- 172.21.15.37:0/3460284802 >> v2:172.21.15.83:3300/0 conn(0x7fa49406f600 0x7fa49414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49ab62700 1 -- 172.21.15.37:0/3460284802 >> v2:172.21.15.83:3300/0 conn(0x7fa49406f600 msgr2=0x7fa49414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:21.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49ab62700 1 --2- 172.21.15.37:0/3460284802 >> v2:172.21.15.83:3300/0 conn(0x7fa49406f600 0x7fa49414fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49ab62700 1 -- 172.21.15.37:0/3460284802 >> v1:172.21.15.83:6789/0 conn(0x7fa49406f230 legacy=0x7fa4940a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49ab62700 1 -- 172.21.15.37:0/3460284802 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940a9b40 con 0x7fa494150330 2023-10-06T04:19:21.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49ab62700 1 --2- 172.21.15.37:0/3460284802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa494157cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa4940cd320 tx=0x7fa484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd51729f6748486 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:21.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49935f700 1 -- 172.21.15.37:0/3460284802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400e070 con 0x7fa494150330 2023-10-06T04:19:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49935f700 1 -- 172.21.15.37:0/3460284802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48400ba50 con 0x7fa494150330 2023-10-06T04:19:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49935f700 1 -- 172.21.15.37:0/3460284802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840092e0 con 0x7fa494150330 2023-10-06T04:19:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49c5c5700 1 -- 172.21.15.37:0/3460284802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 msgr2=0x7fa494157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.697+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/3460284802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa494157cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa4940cd320 tx=0x7fa484009840 comp rx=0 tx=0).stop 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 -- 172.21.15.37:0/3460284802 shutdown_connections 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/3460284802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa494157cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/3460284802 >> v2:172.21.15.83:3300/0 conn(0x7fa49406f600 0x7fa49414fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 -- 172.21.15.37:0/3460284802 >> 172.21.15.37:0/3460284802 conn(0x7fa4940cc250 msgr2=0x7fa4940cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 -- 172.21.15.37:0/3460284802 shutdown_connections 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.698+0000 7fa49c5c5700 1 -- 172.21.15.37:0/3460284802 wait complete. 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 Processor -- start 2023-10-06T04:19:21.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 -- start start 2023-10-06T04:19:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa49406f230 0x7fa49414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa49406f600 0x7fa4940ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940cb430 con 0x7fa494150330 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49414a6b0 con 0x7fa49406f600 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.699+0000 7fa49c5c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa494097200 con 0x7fa49406f230 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60316/0 (socket says 172.21.15.37:60316) 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 -- 172.21.15.37:0/361109741 learned_addr learned my addr 172.21.15.37:0/361109741 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa499b60700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa49406f600 0x7fa4940ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49a361700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa49406f230 0x7fa49414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 -- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa49406f230 msgr2=0x7fa49414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa49406f230 0x7fa49414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 -- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa49406f600 msgr2=0x7fa4940ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa49406f600 0x7fa4940ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 -- 172.21.15.37:0/361109741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009ae0 con 0x7fa494150330 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49ab62700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa494069090 tx=0x7fa484018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400be60 con 0x7fa494150330 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484008d20 con 0x7fa494150330 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940c8af0 con 0x7fa494150330 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48401c660 con 0x7fa494150330 2023-10-06T04:19:21.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.700+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940c90b0 con 0x7fa494150330 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.701+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa494063410 con 0x7fa494150330 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.702+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa484003040 con 0x7fa494150330 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.702+0000 7fa4927fc700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.702+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa484085b30 con 0x7fa494150330 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.702+0000 7fa49a361700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.703+0000 7fa49a361700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 0x7fa4800693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007fd0 tx=0x7fa48c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:21.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.706+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa484052f40 con 0x7fa494150330 2023-10-06T04:19:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.901+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa494097390 con 0x7fa494150330 2023-10-06T04:19:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.902+0000 7fa4927fc700 1 -- 172.21.15.37:0/361109741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13731 (secure 0 0 0) 0x7fa484009940 con 0x7fa494150330 2023-10-06T04:19:21.903 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:21.904 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:19:19.832662+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/2973556572":"2023-10-07T04:19:16.481527+0000","172.21.15.37:6834/2973556572":"2023-10-07T04:19:16.481527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 msgr2=0x7fa4800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 0x7fa4800693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007fd0 tx=0x7fa48c007eb0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 msgr2=0x7fa4940b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa494069090 tx=0x7fa484018000 comp rx=0 tx=0).stop 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 shutdown_connections 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494150330 0x7fa4940b0900 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa49406f230 0x7fa49414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fa480066f30 0x7fa4800693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 --2- 172.21.15.37:0/361109741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa49406f600 0x7fa4940ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 >> 172.21.15.37:0/361109741 conn(0x7fa4940cc250 msgr2=0x7fa49414a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 shutdown_connections 2023-10-06T04:19:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:21.904+0000 7fa49c5c5700 1 -- 172.21.15.37:0/361109741 wait complete. 2023-10-06T04:19:21.918 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:19:21.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:19:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.036+0000 7f06933f7700 1 Processor -- start 2023-10-06T04:19:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.036+0000 7f06933f7700 1 -- start start 2023-10-06T04:19:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06933f7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f068c0cb470 0x7f068c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06933f7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f068c0ccb90 0x7f068c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06933f7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c0cf460 con 0x7f068c0b2810 2023-10-06T04:19:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06933f7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c0cfe30 con 0x7f068c0cb470 2023-10-06T04:19:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06933f7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c159b20 con 0x7f068c0ccb90 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06923f5700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f068c0b2810 0x7f068c15db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37914/0 (socket says 172.21.15.37:37914) 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06923f5700 1 -- 172.21.15.37:0/2288636850 learned_addr learned my addr 172.21.15.37:0/2288636850 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f0691bf4700 1 --2- 172.21.15.37:0/2288636850 >> v2:172.21.15.37:3300/0 conn(0x7f068c0cb470 0x7f068c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f0692bf6700 1 --2- 172.21.15.37:0/2288636850 >> v2:172.21.15.83:3300/0 conn(0x7f068c0ccb90 0x7f068c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06913f3700 1 -- 172.21.15.37:0/2288636850 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531159763 0 0) 0x7f068c0cf460 con 0x7f068c0b2810 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.037+0000 7f06913f3700 1 -- 172.21.15.37:0/2288636850 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0674003570 con 0x7f068c0b2810 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f0691bf4700 1 -- 172.21.15.37:0/2288636850 >> v2:172.21.15.83:3300/0 conn(0x7f068c0ccb90 msgr2=0x7f068c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f0691bf4700 1 --2- 172.21.15.37:0/2288636850 >> v2:172.21.15.83:3300/0 conn(0x7f068c0ccb90 0x7f068c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f0691bf4700 1 -- 172.21.15.37:0/2288636850 >> v1:172.21.15.37:6789/0 conn(0x7f068c0b2810 legacy=0x7f068c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f0691bf4700 1 -- 172.21.15.37:0/2288636850 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0ce890 con 0x7f068c0cb470 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f0691bf4700 1 --2- 172.21.15.37:0/2288636850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c0cf8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f068c0cb8f0 tx=0x7f06800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f46c0113f552f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06913f3700 1 -- 172.21.15.37:0/2288636850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011630 con 0x7f068c0cb470 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06913f3700 1 -- 172.21.15.37:0/2288636850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800117b0 con 0x7f068c0cb470 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06913f3700 1 -- 172.21.15.37:0/2288636850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680011b70 con 0x7f068c0cb470 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 -- 172.21.15.37:0/2288636850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 msgr2=0x7f068c0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 --2- 172.21.15.37:0/2288636850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c0cf8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f068c0cb8f0 tx=0x7f06800091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 -- 172.21.15.37:0/2288636850 shutdown_connections 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 --2- 172.21.15.37:0/2288636850 >> v2:172.21.15.83:3300/0 conn(0x7f068c0ccb90 0x7f068c0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 --2- 172.21.15.37:0/2288636850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c0cf8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.038+0000 7f06933f7700 1 -- 172.21.15.37:0/2288636850 >> 172.21.15.37:0/2288636850 conn(0x7f068c06ed90 msgr2=0x7f068c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.039+0000 7f06933f7700 1 -- 172.21.15.37:0/2288636850 shutdown_connections 2023-10-06T04:19:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.039+0000 7f06933f7700 1 -- 172.21.15.37:0/2288636850 wait complete. 2023-10-06T04:19:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 Processor -- start 2023-10-06T04:19:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 -- start start 2023-10-06T04:19:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 0x7f068c16d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068c0ccb90 0x7f068c1694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c146b60 con 0x7f068c0cb470 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c16a6c0 con 0x7f068c0b2810 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.040+0000 7f06933f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c16a9a0 con 0x7f068c0ccb90 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60334/0 (socket says 172.21.15.37:60334) 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 -- 172.21.15.37:0/893111406 learned_addr learned my addr 172.21.15.37:0/893111406 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f06923f5700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 0x7f068c16d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0692bf6700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068c0ccb90 0x7f068c1694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 -- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068c0ccb90 msgr2=0x7f068c1694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068c0ccb90 0x7f068c1694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 -- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 msgr2=0x7f068c16d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 0x7f068c16d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 -- 172.21.15.37:0/893111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680009420 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f06923f5700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 0x7f068c16d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f0691bf4700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0680013000 tx=0x7f0680017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068001f070 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680011920 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680023410 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c169d40 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.041+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c16a300 con 0x7f068c0cb470 2023-10-06T04:19:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.042+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c16ab50 con 0x7f068c0cb470 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.043+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f068002c3b0 con 0x7f068c0cb470 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.043+0000 7f068a7fc700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.043+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0680085620 con 0x7f068c0cb470 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.043+0000 7f06923f5700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.044+0000 7f06923f5700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 0x7f06780693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f068c0c7190 tx=0x7f067c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.047+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f068c16ab50 con 0x7f068c0cb470 2023-10-06T04:19:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.235+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f068c16ab10 con 0x7f0678066f30 2023-10-06T04:19:22.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.238+0000 7f068a7fc700 1 -- 172.21.15.37:0/893111406 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73730 (secure 0 0 0) 0x7f068c16ab10 con 0x7f0678066f30 2023-10-06T04:19:22.240 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 msgr2=0x7f06780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 0x7f06780693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f068c0c7190 tx=0x7f067c009040 comp rx=0 tx=0).stop 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 msgr2=0x7f068c146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0680013000 tx=0x7f0680017000 comp rx=0 tx=0).stop 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 shutdown_connections 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f068c0ccb90 0x7f068c1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f068c0b2810 0x7f068c16d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 --2- 172.21.15.37:0/893111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f068c0cb470 0x7f068c146620 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 >> 172.21.15.37:0/893111406 conn(0x7f068c06ed90 msgr2=0x7f068c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 shutdown_connections 2023-10-06T04:19:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.240+0000 7f06933f7700 1 -- 172.21.15.37:0/893111406 wait complete. 2023-10-06T04:19:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:19:22.254 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-10-06T04:19:21.519351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2383500,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591220,"statfs":{"total":773094113280,"available":770653409280,"internally_reserved":0,"allocated":5320704,"data_stored":3234210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572761,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-117,"num_write_kb":-614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758450+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:18:36.758450+0000","last_peered":"2023-10-06T04:18:36.758450+0000","last_clean":"2023-10-06T04:18:36.758450+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:18:36.758450+0000","last_undegraded":"2023-10-06T04:18:36.758450+0000","last_fullsized":"2023-10-06T04:18:36.758450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836603+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:19:18.836603+0000","last_peered":"2023-10-06T04:19:18.836603+0000","last_clean":"2023-10-06T04:19:18.836603+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:19:18.836603+0000","last_undegraded":"2023-10-06T04:19:18.836603+0000","last_fullsized":"2023-10-06T04:19:18.836603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836110+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:19:18.836110+0000","last_peered":"2023-10-06T04:19:18.836110+0000","last_clean":"2023-10-06T04:19:18.836110+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:19:18.836110+0000","last_undegraded":"2023-10-06T04:19:18.836110+0000","last_fullsized":"2023-10-06T04:19:18.836110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835724+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:19:18.835724+0000","last_peered":"2023-10-06T04:19:18.835724+0000","last_clean":"2023-10-06T04:19:18.835724+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:19:18.835724+0000","last_undegraded":"2023-10-06T04:19:18.835724+0000","last_fullsized":"2023-10-06T04:19:18.835724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834950+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:19:18.834950+0000","last_peered":"2023-10-06T04:19:18.834950+0000","last_clean":"2023-10-06T04:19:18.834950+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:19:18.834950+0000","last_undegraded":"2023-10-06T04:19:18.834950+0000","last_fullsized":"2023-10-06T04:19:18.834950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834914+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:19:18.834914+0000","last_peered":"2023-10-06T04:19:18.834914+0000","last_clean":"2023-10-06T04:19:18.834914+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:19:18.834914+0000","last_undegraded":"2023-10-06T04:19:18.834914+0000","last_fullsized":"2023-10-06T04:19:18.834914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835926+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:19:18.835926+0000","last_peered":"2023-10-06T04:19:18.835926+0000","last_clean":"2023-10-06T04:19:18.835926+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:19:18.835926+0000","last_undegraded":"2023-10-06T04:19:18.835926+0000","last_fullsized":"2023-10-06T04:19:18.835926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758786+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:18:36.758786+0000","last_peered":"2023-10-06T04:18:36.758786+0000","last_clean":"2023-10-06T04:18:36.758786+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:18:36.758786+0000","last_undegraded":"2023-10-06T04:18:36.758786+0000","last_fullsized":"2023-10-06T04:18:36.758786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.954523+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:19:18.954523+0000","last_peered":"2023-10-06T04:19:18.954523+0000","last_clean":"2023-10-06T04:19:18.954523+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:19:18.954523+0000","last_undegraded":"2023-10-06T04:19:18.954523+0000","last_fullsized":"2023-10-06T04:19:18.954523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.0329999999999999,"15min":1.129},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.57199999999999995,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.56200000000000006,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.95899999999999996,"15min":1.03},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.59699999999999998,"5min":11.288,"15min":11.288},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.90900000000000003,"15min":0.97999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61499999999999999,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.90800000000000003,"15min":0.98399999999999999},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52800000000000002,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.98299999999999998,"15min":1.0580000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65600000000000003,"5min":11.33,"15min":11.33},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.60199999999999998,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.67700000000000005,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.745,"15min":0.745},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.624,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68400000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.372},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.63600000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70199999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":169121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.47099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40699999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.50800000000000001,"5min":0.752,"15min":0.752},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49099999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.314}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":1.002,"15min":1.002},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76700000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63800000000000001,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71899999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80100000000000005,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76100000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.78100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":759433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.379},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.253,"5min":0.247,"15min":0.247},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.42399999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.63100000000000001,"15min":0.58499999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":5.7000000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.7320000000000002,"5min":5.7320000000000002,"15min":5.7320000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.23200000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.42299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34599999999999997,"15min":0.35099999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.28199999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47799999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.45800000000000002,"5min":0.629,"15min":0.629},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":1032192,"data_stored":776398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33400000000000002,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.31900000000000001},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.48099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.49199999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":1.141,"15min":1.141},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57899999999999996,"5min":0.746,"15min":0.746},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.58799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79900000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.747,"15min":0.747},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.61299999999999999,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.6690000000000005,"5min":8.6690000000000005,"15min":8.6690000000000005},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.64800000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.749,"15min":0.749},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:19:22.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:19:22.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.374+0000 7ff975c47700 1 Processor -- start 2023-10-06T04:19:22.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.374+0000 7ff975c47700 1 -- start start 2023-10-06T04:19:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff975c47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff9700cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff975c47700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700cf460 con 0x7ff9700b2810 2023-10-06T04:19:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff975c47700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700ce890 con 0x7ff9700cb470 2023-10-06T04:19:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff975c47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700cfe30 con 0x7ff9700cd2a0 2023-10-06T04:19:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff974c45700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff9700b2810 0x7ff97015db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37922/0 (socket says 172.21.15.37:37922) 2023-10-06T04:19:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff974c45700 1 -- 172.21.15.37:0/3814613494 learned_addr learned my addr 172.21.15.37:0/3814613494 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262718321 0 0) 0x7ff9700cf460 con 0x7ff9700b2810 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff975446700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff9700cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.375+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff95c003570 con 0x7ff9700b2810 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510286984 0 0) 0x7ff95c003570 con 0x7ff9700b2810 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 msgr2=0x7ff9700cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff9700cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 >> v1:172.21.15.83:6789/0 conn(0x7ff9700cb470 legacy=0x7ff9700ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700ceb30 con 0x7ff9700b2810 2023-10-06T04:19:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7ff958001470 con 0x7ff9700b2810 2023-10-06T04:19:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 >> v1:172.21.15.37:6789/0 conn(0x7ff9700b2810 legacy=0x7ff97015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff95c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff95c004010 0x7ff95c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700cfe30 con 0x7ff95c004d50 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00bc70 con 0x7ff95c004010 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00be30 con 0x7ff9700cd2a0 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff974c45700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff95c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96ffff700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff95c004010 0x7ff95c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 -- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 msgr2=0x7ff95c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9700cd2a0 0x7ff95c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 -- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff95c004010 msgr2=0x7ff95c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff95c004010 0x7ff95c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 -- 172.21.15.37:0/3814613494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c003570 con 0x7ff95c004d50 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff975446700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff968006f00 tx=0x7ff9680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46554a18f99384f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800e710 con 0x7ff95c004d50 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.376+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800e870 con 0x7ff95c004d50 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff96f7fe700 1 -- 172.21.15.37:0/3814613494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800ec30 con 0x7ff95c004d50 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 -- 172.21.15.37:0/3814613494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff95c004d50 msgr2=0x7ff95c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 --2- 172.21.15.37:0/3814613494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff95c004d50 0x7ff95c0051c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff968006f00 tx=0x7ff9680091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975446700 1 -- 172.21.15.37:0/3814613494 reap_dead start 2023-10-06T04:19:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 -- 172.21.15.37:0/3814613494 shutdown_connections 2023-10-06T04:19:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 -- 172.21.15.37:0/3814613494 >> 172.21.15.37:0/3814613494 conn(0x7ff97006ed90 msgr2=0x7ff97006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 -- 172.21.15.37:0/3814613494 shutdown_connections 2023-10-06T04:19:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.377+0000 7ff975c47700 1 -- 172.21.15.37:0/3814613494 wait complete. 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.378+0000 7ff975c47700 1 Processor -- start 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.378+0000 7ff975c47700 1 -- start start 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9701550f0 0x7ff9700ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9701554c0 0x7ff9700c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700a98a0 con 0x7ff9700acda0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700a75e0 con 0x7ff9701554c0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975c47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700a95c0 con 0x7ff9701550f0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60364/0 (socket says 172.21.15.37:60364) 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 -- 172.21.15.37:0/4067665166 learned_addr learned my addr 172.21.15.37:0/4067665166 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff974c45700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9701550f0 0x7ff9700ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff96ffff700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9701554c0 0x7ff9700c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 -- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9701550f0 msgr2=0x7ff9700ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9701550f0 0x7ff9700ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 -- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9701554c0 msgr2=0x7ff9700c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9701554c0 0x7ff9700c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.379+0000 7ff975446700 1 -- 172.21.15.37:0/4067665166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700a6f90 con 0x7ff9700acda0 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff975446700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bc40 tx=0x7ff96801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968022070 con 0x7ff9700acda0 2023-10-06T04:19:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800ebf0 con 0x7ff9700acda0 2023-10-06T04:19:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700a7270 con 0x7ff9700acda0 2023-10-06T04:19:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800e710 con 0x7ff9700acda0 2023-10-06T04:19:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.380+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700a7c30 con 0x7ff9700acda0 2023-10-06T04:19:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.381+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97004c3c0 con 0x7ff9700acda0 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.381+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff96801c970 con 0x7ff9700acda0 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.382+0000 7ff96cff9700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.382+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff968000e40 con 0x7ff9700acda0 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.382+0000 7ff974c45700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.382+0000 7ff974c45700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 0x7ff9500693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9580010e0 tx=0x7ff958001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.386+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9680525c0 con 0x7ff9700acda0 2023-10-06T04:19:22.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.575+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9700a98a0 con 0x7ff950066f30 2023-10-06T04:19:22.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.579+0000 7ff96cff9700 1 -- 172.21.15.37:0/4067665166 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73730 (secure 0 0 0) 0x7ff9700a98a0 con 0x7ff950066f30 2023-10-06T04:19:22.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 msgr2=0x7ff9500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 0x7ff9500693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9580010e0 tx=0x7ff958001e50 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 msgr2=0x7ff9700c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bc40 tx=0x7ff96801a000 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 shutdown_connections 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700acda0 0x7ff9700c9bb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff9701550f0 0x7ff9700ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff950066f30 0x7ff9500693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 --2- 172.21.15.37:0/4067665166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff9701554c0 0x7ff9700c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 >> 172.21.15.37:0/4067665166 conn(0x7ff97006ed90 msgr2=0x7ff9700c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 shutdown_connections 2023-10-06T04:19:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.581+0000 7ff975c47700 1 -- 172.21.15.37:0/4067665166 wait complete. 2023-10-06T04:19:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:19:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-10-06T04:19:21.519351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2383500,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591220,"statfs":{"total":773094113280,"available":770653409280,"internally_reserved":0,"allocated":5320704,"data_stored":3234210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572761,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-117,"num_write_kb":-614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758450+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:18:36.758450+0000","last_peered":"2023-10-06T04:18:36.758450+0000","last_clean":"2023-10-06T04:18:36.758450+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:18:36.758450+0000","last_undegraded":"2023-10-06T04:18:36.758450+0000","last_fullsized":"2023-10-06T04:18:36.758450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836603+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:19:18.836603+0000","last_peered":"2023-10-06T04:19:18.836603+0000","last_clean":"2023-10-06T04:19:18.836603+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:19:18.836603+0000","last_undegraded":"2023-10-06T04:19:18.836603+0000","last_fullsized":"2023-10-06T04:19:18.836603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836110+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:19:18.836110+0000","last_peered":"2023-10-06T04:19:18.836110+0000","last_clean":"2023-10-06T04:19:18.836110+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:19:18.836110+0000","last_undegraded":"2023-10-06T04:19:18.836110+0000","last_fullsized":"2023-10-06T04:19:18.836110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835724+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:19:18.835724+0000","last_peered":"2023-10-06T04:19:18.835724+0000","last_clean":"2023-10-06T04:19:18.835724+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:19:18.835724+0000","last_undegraded":"2023-10-06T04:19:18.835724+0000","last_fullsized":"2023-10-06T04:19:18.835724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834950+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:19:18.834950+0000","last_peered":"2023-10-06T04:19:18.834950+0000","last_clean":"2023-10-06T04:19:18.834950+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:19:18.834950+0000","last_undegraded":"2023-10-06T04:19:18.834950+0000","last_fullsized":"2023-10-06T04:19:18.834950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834914+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:19:18.834914+0000","last_peered":"2023-10-06T04:19:18.834914+0000","last_clean":"2023-10-06T04:19:18.834914+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:19:18.834914+0000","last_undegraded":"2023-10-06T04:19:18.834914+0000","last_fullsized":"2023-10-06T04:19:18.834914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835926+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:19:18.835926+0000","last_peered":"2023-10-06T04:19:18.835926+0000","last_clean":"2023-10-06T04:19:18.835926+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:19:18.835926+0000","last_undegraded":"2023-10-06T04:19:18.835926+0000","last_fullsized":"2023-10-06T04:19:18.835926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758786+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:18:36.758786+0000","last_peered":"2023-10-06T04:18:36.758786+0000","last_clean":"2023-10-06T04:18:36.758786+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:18:36.758786+0000","last_undegraded":"2023-10-06T04:18:36.758786+0000","last_fullsized":"2023-10-06T04:18:36.758786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.954523+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:19:18.954523+0000","last_peered":"2023-10-06T04:19:18.954523+0000","last_clean":"2023-10-06T04:19:18.954523+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:19:18.954523+0000","last_undegraded":"2023-10-06T04:19:18.954523+0000","last_fullsized":"2023-10-06T04:19:18.954523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.0329999999999999,"15min":1.129},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.57199999999999995,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.56200000000000006,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.95899999999999996,"15min":1.03},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.59699999999999998,"5min":11.288,"15min":11.288},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.90900000000000003,"15min":0.97999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61499999999999999,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.90800000000000003,"15min":0.98399999999999999},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52800000000000002,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.98299999999999998,"15min":1.0580000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65600000000000003,"5min":11.33,"15min":11.33},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.60199999999999998,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.67700000000000005,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.745,"15min":0.745},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.624,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68400000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.372},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.63600000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70199999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":169121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.47099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40699999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.50800000000000001,"5min":0.752,"15min":0.752},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49099999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.314}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":1.002,"15min":1.002},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76700000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63800000000000001,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71899999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80100000000000005,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76100000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.78100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":759433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.379},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.253,"5min":0.247,"15min":0.247},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.42399999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.63100000000000001,"15min":0.58499999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":5.7000000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.7320000000000002,"5min":5.7320000000000002,"15min":5.7320000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.23200000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.42299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34599999999999997,"15min":0.35099999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.28199999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47799999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.45800000000000002,"5min":0.629,"15min":0.629},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":1032192,"data_stored":776398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33400000000000002,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.31900000000000001},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.48099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.49199999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":1.141,"15min":1.141},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57899999999999996,"5min":0.746,"15min":0.746},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.58799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79900000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.747,"15min":0.747},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.61299999999999999,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.6690000000000005,"5min":8.6690000000000005,"15min":8.6690000000000005},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.64800000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.749,"15min":0.749},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:19:22.596 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:19:22.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:19:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.713+0000 7ff974512700 1 Processor -- start 2023-10-06T04:19:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.714+0000 7ff974512700 1 -- start start 2023-10-06T04:19:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.714+0000 7ff974512700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff96c161550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.714+0000 7ff974512700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c1586e0 con 0x7ff96c1509f0 2023-10-06T04:19:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff974512700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c157ba0 con 0x7ff96c06ee60 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff974512700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c157e20 con 0x7ff96c0ada10 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9722ae700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff96c1509f0 0x7ff96c06e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37934/0 (socket says 172.21.15.37:37934) 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9722ae700 1 -- 172.21.15.37:0/1725195346 learned_addr learned my addr 172.21.15.37:0/1725195346 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff972aaf700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff96c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834202258 0 0) 0x7ff96c1586e0 con 0x7ff96c1509f0 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003570 con 0x7ff96c1509f0 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639520311 0 0) 0x7ff954003570 con 0x7ff96c1509f0 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 msgr2=0x7ff96c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff96c161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 >> v1:172.21.15.83:6789/0 conn(0x7ff96c06ee60 legacy=0x7ff96c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c158090 con 0x7ff96c1509f0 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7ff95c001970 con 0x7ff96c1509f0 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 >> v1:172.21.15.37:6789/0 conn(0x7ff96c1509f0 legacy=0x7ff96c06e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff954003a90 0x7ff954003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff954004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff9540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c157e20 con 0x7ff954004d50 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400bb10 con 0x7ff954003a90 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400bcd0 con 0x7ff96c0ada10 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff972aaf700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff9540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff9722ae700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff954003a90 0x7ff954003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.715+0000 7ff971aad700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff954004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 -- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 msgr2=0x7ff954004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c0ada10 0x7ff954004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 -- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff954003a90 msgr2=0x7ff954003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff954003a90 0x7ff954003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 -- 172.21.15.37:0/1725195346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954003570 con 0x7ff954004d50 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff972aaf700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff9540051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff964009c00 tx=0x7ff9640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200139d660f3ddfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400e710 con 0x7ff954004d50 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400e870 con 0x7ff954004d50 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.716+0000 7ff9712ac700 1 -- 172.21.15.37:0/1725195346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400ec30 con 0x7ff954004d50 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 -- 172.21.15.37:0/1725195346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 msgr2=0x7ff9540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 --2- 172.21.15.37:0/1725195346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff9540051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff964009c00 tx=0x7ff9640091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff972aaf700 1 -- 172.21.15.37:0/1725195346 reap_dead start 2023-10-06T04:19:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 -- 172.21.15.37:0/1725195346 shutdown_connections 2023-10-06T04:19:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 -- 172.21.15.37:0/1725195346 >> 172.21.15.37:0/1725195346 conn(0x7ff96c0cc250 msgr2=0x7ff96c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 -- 172.21.15.37:0/1725195346 shutdown_connections 2023-10-06T04:19:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.717+0000 7ff974512700 1 -- 172.21.15.37:0/1725195346 wait complete. 2023-10-06T04:19:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.718+0000 7ff974512700 1 Processor -- start 2023-10-06T04:19:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.718+0000 7ff974512700 1 -- start start 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c140b80 0x7ff96c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c140ff0 0x7ff96c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c16bb80 con 0x7ff954004d50 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c1550d0 con 0x7ff96c140b80 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c099940 con 0x7ff96c140ff0 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60390/0 (socket says 172.21.15.37:60390) 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 -- 172.21.15.37:0/3618998113 learned_addr learned my addr 172.21.15.37:0/3618998113 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 -- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c140ff0 msgr2=0x7ff96c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c140ff0 0x7ff96c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 -- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c140b80 msgr2=0x7ff96c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c140b80 0x7ff96c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 -- 172.21.15.37:0/3618998113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c16af70 con 0x7ff954004d50 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff9722ae700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00ff30 tx=0x7ff95c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00d970 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00dad0 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00de90 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c16b250 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.719+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c16b810 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.720+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c063410 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.721+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff95c0072e0 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.721+0000 7ff96a7fc700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.721+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff95c084ae0 con 0x7ff954004d50 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.721+0000 7ff971aad700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.722+0000 7ff971aad700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 0x7ff9580693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff960007e20 tx=0x7ff960007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.725+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff95c051ef0 con 0x7ff954004d50 2023-10-06T04:19:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.915+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff96c158370 con 0x7ff958066f30 2023-10-06T04:19:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.918+0000 7ff96a7fc700 1 -- 172.21.15.37:0/3618998113 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73730 (secure 0 0 0) 0x7ff96c158370 con 0x7ff958066f30 2023-10-06T04:19:22.920 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:22.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 msgr2=0x7ff9580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 0x7ff9580693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff960007e20 tx=0x7ff960007d10 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 msgr2=0x7ff96c099400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00ff30 tx=0x7ff95c009040 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 shutdown_connections 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff96c140ff0 0x7ff96c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff954004d50 0x7ff96c099400 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 --2- 172.21.15.37:0/3618998113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c140b80 0x7ff96c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 >> 172.21.15.37:0/3618998113 conn(0x7ff96c0cc250 msgr2=0x7ff96c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 shutdown_connections 2023-10-06T04:19:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:22.920+0000 7ff974512700 1 -- 172.21.15.37:0/3618998113 wait complete. 2023-10-06T04:19:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:19:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-10-06T04:19:21.519351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2383500,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591220,"statfs":{"total":773094113280,"available":770653409280,"internally_reserved":0,"allocated":5320704,"data_stored":3234210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572761,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-117,"num_write_kb":-614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758450+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:18:36.758450+0000","last_peered":"2023-10-06T04:18:36.758450+0000","last_clean":"2023-10-06T04:18:36.758450+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:18:36.758450+0000","last_undegraded":"2023-10-06T04:18:36.758450+0000","last_fullsized":"2023-10-06T04:18:36.758450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836603+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:19:18.836603+0000","last_peered":"2023-10-06T04:19:18.836603+0000","last_clean":"2023-10-06T04:19:18.836603+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:19:18.836603+0000","last_undegraded":"2023-10-06T04:19:18.836603+0000","last_fullsized":"2023-10-06T04:19:18.836603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836110+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:19:18.836110+0000","last_peered":"2023-10-06T04:19:18.836110+0000","last_clean":"2023-10-06T04:19:18.836110+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:19:18.836110+0000","last_undegraded":"2023-10-06T04:19:18.836110+0000","last_fullsized":"2023-10-06T04:19:18.836110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:04.565307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835724+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:19:18.835724+0000","last_peered":"2023-10-06T04:19:18.835724+0000","last_clean":"2023-10-06T04:19:18.835724+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:19:18.835724+0000","last_undegraded":"2023-10-06T04:19:18.835724+0000","last_fullsized":"2023-10-06T04:19:18.835724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834950+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:19:18.834950+0000","last_peered":"2023-10-06T04:19:18.834950+0000","last_clean":"2023-10-06T04:19:18.834950+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:19:18.834950+0000","last_undegraded":"2023-10-06T04:19:18.834950+0000","last_fullsized":"2023-10-06T04:19:18.834950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834914+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:19:18.834914+0000","last_peered":"2023-10-06T04:19:18.834914+0000","last_clean":"2023-10-06T04:19:18.834914+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:19:18.834914+0000","last_undegraded":"2023-10-06T04:19:18.834914+0000","last_fullsized":"2023-10-06T04:19:18.834914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835926+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:19:18.835926+0000","last_peered":"2023-10-06T04:19:18.835926+0000","last_clean":"2023-10-06T04:19:18.835926+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:19:18.835926+0000","last_undegraded":"2023-10-06T04:19:18.835926+0000","last_fullsized":"2023-10-06T04:19:18.835926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:18:36.758786+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:18:36.758786+0000","last_peered":"2023-10-06T04:18:36.758786+0000","last_clean":"2023-10-06T04:18:36.758786+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:18:36.758786+0000","last_undegraded":"2023-10-06T04:18:36.758786+0000","last_fullsized":"2023-10-06T04:18:36.758786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.954523+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:19:18.954523+0000","last_peered":"2023-10-06T04:19:18.954523+0000","last_clean":"2023-10-06T04:19:18.954523+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:19:18.954523+0000","last_undegraded":"2023-10-06T04:19:18.954523+0000","last_fullsized":"2023-10-06T04:19:18.954523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.0329999999999999,"15min":1.129},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.57199999999999995,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.56200000000000006,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.95899999999999996,"15min":1.03},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.59699999999999998,"5min":11.288,"15min":11.288},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.90900000000000003,"15min":0.97999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61499999999999999,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.90800000000000003,"15min":0.98399999999999999},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52800000000000002,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.98299999999999998,"15min":1.0580000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65600000000000003,"5min":11.33,"15min":11.33},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.60199999999999998,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.67700000000000005,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.745,"15min":0.745},"last":0.54400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.624,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68400000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.372},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.63600000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70199999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":169121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.47099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40699999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.50800000000000001,"5min":0.752,"15min":0.752},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49099999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.314}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":1.002,"15min":1.002},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76700000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63800000000000001,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71899999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80100000000000005,"5min":1.046,"15min":1.046},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76100000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.78100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":759433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.379},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.253,"5min":0.247,"15min":0.247},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.42399999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.63100000000000001,"15min":0.58499999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":5.7000000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.7320000000000002,"5min":5.7320000000000002,"15min":5.7320000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.23200000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.42299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34599999999999997,"15min":0.35099999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.28199999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47799999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.45800000000000002,"5min":0.629,"15min":0.629},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":1032192,"data_stored":776398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33400000000000002,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.31900000000000001},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.48099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.49199999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.82199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":1.141,"15min":1.141},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57899999999999996,"5min":0.746,"15min":0.746},"last":0.66900000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.58799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79900000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.747,"15min":0.747},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.61299999999999999,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.6690000000000005,"5min":8.6690000000000005,"15min":8.6690000000000005},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.64800000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.749,"15min":0.749},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.504},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:19:22.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:19:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.054+0000 7f02c23d0700 1 Processor -- start 2023-10-06T04:19:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.054+0000 7f02c23d0700 1 -- start start 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c23d0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f02bc0b2810 0x7f02bc0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c23d0700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0cf460 con 0x7f02bc0ccb90 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c23d0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0ce890 con 0x7f02bc0cb470 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c23d0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0cfe30 con 0x7f02bc0b2810 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c1bcf700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02bc0ccb90 0x7f02bc0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37940/0 (socket says 172.21.15.37:37940) 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c1bcf700 1 -- 172.21.15.37:0/307438660 learned_addr learned my addr 172.21.15.37:0/307438660 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02c13ce700 1 --2- 172.21.15.37:0/307438660 >> v2:172.21.15.83:3300/0 conn(0x7f02bc0b2810 0x7f02bc0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343252765 0 0) 0x7f02bc0cf460 con 0x7f02bc0ccb90 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.055+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a8003570 con 0x7f02bc0ccb90 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524984687 0 0) 0x7f02bc0ce890 con 0x7f02bc0cb470 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02bc0cf460 con 0x7f02bc0cb470 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873544268 0 0) 0x7f02a8003570 con 0x7f02bc0ccb90 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 >> v2:172.21.15.83:3300/0 conn(0x7f02bc0b2810 msgr2=0x7f02bc0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 --2- 172.21.15.37:0/307438660 >> v2:172.21.15.83:3300/0 conn(0x7f02bc0b2810 0x7f02bc0cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 >> v1:172.21.15.83:6789/0 conn(0x7f02bc0cb470 legacy=0x7f02bc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0ceb30 con 0x7f02bc0ccb90 2023-10-06T04:19:23.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f02b40017f0 con 0x7f02bc0ccb90 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 >> v1:172.21.15.37:6789/0 conn(0x7f02bc0ccb90 legacy=0x7f02bc0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02a8003bf0 0x7f02a8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02a80051c0 0x7f02a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0cfe30 con 0x7f02a8004810 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c160 con 0x7f02a80051c0 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c320 con 0x7f02a8003bf0 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c13ce700 1 --2- 172.21.15.37:0/307438660 >> v2:172.21.15.83:3300/0 conn(0x7f02bc0b2810 0x7f02bc0cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:19:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c1bcf700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02a80051c0 0x7f02a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c13ce700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02a8003bf0 0x7f02a8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 -- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02a8003bf0 msgr2=0x7f02a8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02a8003bf0 0x7f02a8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 -- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02a80051c0 msgr2=0x7f02a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02a80051c0 0x7f02a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 -- 172.21.15.37:0/307438660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8003570 con 0x7f02a8004810 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c1bcf700 1 -- 172.21.15.37:0/307438660 reap_dead start 2023-10-06T04:19:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.056+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02a8004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001050 tx=0x7f02ac007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73b4a0f2e0bce10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00c5a0 con 0x7f02a8004810 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac00c700 con 0x7f02a8004810 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02b3fff700 1 -- 172.21.15.37:0/307438660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00cac0 con 0x7f02a8004810 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 -- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 msgr2=0x7f02a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02a8004c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001050 tx=0x7f02ac007d10 comp rx=0 tx=0).stop 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 -- 172.21.15.37:0/307438660 shutdown_connections 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 --2- 172.21.15.37:0/307438660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02a8004c80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 -- 172.21.15.37:0/307438660 >> 172.21.15.37:0/307438660 conn(0x7f02bc06ed90 msgr2=0x7f02bc06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 -- 172.21.15.37:0/307438660 shutdown_connections 2023-10-06T04:19:23.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.057+0000 7f02c23d0700 1 -- 172.21.15.37:0/307438660 wait complete. 2023-10-06T04:19:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.058+0000 7f02c23d0700 1 Processor -- start 2023-10-06T04:19:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.058+0000 7f02c23d0700 1 -- start start 2023-10-06T04:19:23.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02bc156570 0x7f02bc169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02bc16a060 0x7f02bc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc16a4d0 con 0x7f02a8004810 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc16acc0 con 0x7f02bc156570 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c23d0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b51b0 con 0x7f02bc16a060 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c13ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c13ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60404/0 (socket says 172.21.15.37:60404) 2023-10-06T04:19:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c13ce700 1 -- 172.21.15.37:0/452855646 learned_addr learned my addr 172.21.15.37:0/452855646 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02bc156570 0x7f02bc169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.059+0000 7f02c1bcf700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02bc16a060 0x7f02bc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 -- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02bc16a060 msgr2=0x7f02bc15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02bc16a060 0x7f02bc15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 -- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02bc156570 msgr2=0x7f02bc169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02bc156570 0x7f02bc169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 -- 172.21.15.37:0/452855646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0b45e0 con 0x7f02a8004810 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c13ce700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02b8011a20 tx=0x7f02b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011e60 con 0x7f02a8004810 2023-10-06T04:19:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800f880 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc16a700 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800fc00 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.060+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0b4e40 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.061+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc04c3c0 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.061+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02b8015460 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.062+0000 7f02b17fa700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.062+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f02b8084b40 con 0x7f02a8004810 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.062+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.062+0000 7f02c0bcd700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 0x7f02a00693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000c00 tx=0x7f02ac015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.066+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02b8051f50 con 0x7f02a8004810 2023-10-06T04:19:23.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.262+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02bc0afb10 con 0x7f02a8004810 2023-10-06T04:19:23.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.262+0000 7f02b17fa700 1 -- 172.21.15.37:0/452855646 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13731 (secure 0 0 0) 0x7f02b8055570 con 0x7f02a8004810 2023-10-06T04:19:23.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:23.264 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"fsid":"40813f02-7e3b-4d33-ae21-8c35b4fd9578","created":"2023-10-06T04:16:29.901244+0000","modified":"2023-10-06T04:19:19.832662+0000","last_up_change":"2023-10-06T04:16:41.482519+0000","last_in_change":"2023-10-06T04:16:32.710051+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T04:16:41.535173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T04:16:48.653427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15975640-5e97-4fdf-bb02-0655d8c0403b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90645},{"type":"v1","addr":"172.21.15.37:6809","nonce":90645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90645},{"type":"v1","addr":"172.21.15.37:6811","nonce":90645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90645},{"type":"v1","addr":"172.21.15.37:6815","nonce":90645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90645},{"type":"v1","addr":"172.21.15.37:6813","nonce":90645}]},"public_addr":"172.21.15.37:6809/90645","cluster_addr":"172.21.15.37:6811/90645","heartbeat_back_addr":"172.21.15.37:6815/90645","heartbeat_front_addr":"172.21.15.37:6813/90645","state":["exists","up"]},{"osd":1,"uuid":"6eb4e93d-fa22-4795-9fad-7f819f02c729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90646},{"type":"v1","addr":"172.21.15.37:6801","nonce":90646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90646},{"type":"v1","addr":"172.21.15.37:6803","nonce":90646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90646},{"type":"v1","addr":"172.21.15.37:6807","nonce":90646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90646},{"type":"v1","addr":"172.21.15.37:6805","nonce":90646}]},"public_addr":"172.21.15.37:6801/90646","cluster_addr":"172.21.15.37:6803/90646","heartbeat_back_addr":"172.21.15.37:6807/90646","heartbeat_front_addr":"172.21.15.37:6805/90646","state":["exists","up"]},{"osd":2,"uuid":"812a09ba-e1f2-4dd2-b3c1-570c77a5e35a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90657},{"type":"v1","addr":"172.21.15.37:6817","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":90657},{"type":"v1","addr":"172.21.15.37:6819","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":90657},{"type":"v1","addr":"172.21.15.37:6826","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90657},{"type":"v1","addr":"172.21.15.37:6822","nonce":90657}]},"public_addr":"172.21.15.37:6817/90657","cluster_addr":"172.21.15.37:6819/90657","heartbeat_back_addr":"172.21.15.37:6826/90657","heartbeat_front_addr":"172.21.15.37:6822/90657","state":["exists","up"]},{"osd":3,"uuid":"7960843c-4d66-4343-bf35-28d637649874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90670},{"type":"v1","addr":"172.21.15.37:6823","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":90670},{"type":"v1","addr":"172.21.15.37:6827","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90670},{"type":"v1","addr":"172.21.15.37:6831","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":90670},{"type":"v1","addr":"172.21.15.37:6829","nonce":90670}]},"public_addr":"172.21.15.37:6823/90670","cluster_addr":"172.21.15.37:6827/90670","heartbeat_back_addr":"172.21.15.37:6831/90670","heartbeat_front_addr":"172.21.15.37:6829/90670","state":["exists","up"]},{"osd":4,"uuid":"efc6b257-4e05-4b54-81d7-10aec757d2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":90892},{"type":"v1","addr":"172.21.15.83:6801","nonce":90892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":90892},{"type":"v1","addr":"172.21.15.83:6803","nonce":90892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":90892},{"type":"v1","addr":"172.21.15.83:6807","nonce":90892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":90892},{"type":"v1","addr":"172.21.15.83:6805","nonce":90892}]},"public_addr":"172.21.15.83:6801/90892","cluster_addr":"172.21.15.83:6803/90892","heartbeat_back_addr":"172.21.15.83:6807/90892","heartbeat_front_addr":"172.21.15.83:6805/90892","state":["exists","up"]},{"osd":5,"uuid":"52fe37c0-1d51-42f3-bb5d-3b98238dec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":90893},{"type":"v1","addr":"172.21.15.83:6809","nonce":90893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":90893},{"type":"v1","addr":"172.21.15.83:6811","nonce":90893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":90893},{"type":"v1","addr":"172.21.15.83:6815","nonce":90893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":90893},{"type":"v1","addr":"172.21.15.83:6813","nonce":90893}]},"public_addr":"172.21.15.83:6809/90893","cluster_addr":"172.21.15.83:6811/90893","heartbeat_back_addr":"172.21.15.83:6815/90893","heartbeat_front_addr":"172.21.15.83:6813/90893","state":["exists","up"]},{"osd":6,"uuid":"edfe94f1-d8a1-48ab-844b-e4dce68f140f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":90923},{"type":"v1","addr":"172.21.15.83:6817","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":90923},{"type":"v1","addr":"172.21.15.83:6819","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":90923},{"type":"v1","addr":"172.21.15.83:6827","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":90923},{"type":"v1","addr":"172.21.15.83:6823","nonce":90923}]},"public_addr":"172.21.15.83:6817/90923","cluster_addr":"172.21.15.83:6819/90923","heartbeat_back_addr":"172.21.15.83:6827/90923","heartbeat_front_addr":"172.21.15.83:6823/90923","state":["exists","up"]},{"osd":7,"uuid":"8e30625c-4ccf-4858-9ac2-e0a13687671f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":90922},{"type":"v1","addr":"172.21.15.83:6822","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":90922},{"type":"v1","addr":"172.21.15.83:6826","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":90922},{"type":"v1","addr":"172.21.15.83:6831","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":90922},{"type":"v1","addr":"172.21.15.83:6829","nonce":90922}]},"public_addr":"172.21.15.83:6822/90922","cluster_addr":"172.21.15.83:6826/90922","heartbeat_back_addr":"172.21.15.83:6831/90922","heartbeat_front_addr":"172.21.15.83:6829/90922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.601220+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.842567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.823183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.858096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.851718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.946952+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:16:37.897765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/2973556572":"2023-10-07T04:19:16.481527+0000","172.21.15.37:6834/2973556572":"2023-10-07T04:19:16.481527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:19:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 msgr2=0x7f02a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 0x7f02a00693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000c00 tx=0x7f02ac015000 comp rx=0 tx=0).stop 2023-10-06T04:19:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 msgr2=0x7f02bc152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02b8011a20 tx=0x7f02b8008040 comp rx=0 tx=0).stop 2023-10-06T04:19:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 shutdown_connections 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f02bc16a060 0x7f02bc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02a8004810 0x7f02bc152370 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f02a0066f30 0x7f02a00693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 --2- 172.21.15.37:0/452855646 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02bc156570 0x7f02bc169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.264+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 >> 172.21.15.37:0/452855646 conn(0x7f02bc06ed90 msgr2=0x7f02bc15d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.265+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 shutdown_connections 2023-10-06T04:19:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:23.265+0000 7f02c23d0700 1 -- 172.21.15.37:0/452855646 wait complete. 2023-10-06T04:19:24.279 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:19:24.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:24.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.415+0000 7f8ba13ab700 1 Processor -- start 2023-10-06T04:19:24.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.415+0000 7f8ba13ab700 1 -- start start 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.415+0000 7f8ba13ab700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b9c09b0c0 0x7f8b9c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8ba13ab700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c06a290 0x7f8b9c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8ba13ab700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0c9a50 con 0x7f8b9c09b490 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8ba13ab700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0ccb20 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8ba13ab700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c068e80 con 0x7f8b9c06a290 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b9c09b0c0 0x7f8b9c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9a7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b9c09b490 0x7f8b9c068770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2023-10-06T04:19:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9a7fc700 1 -- 172.21.15.37:0/3557266415 learned_addr learned my addr 172.21.15.37:0/3557266415 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9b7fe700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c06a290 0x7f8b9c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 -- 172.21.15.37:0/3557266415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c06a290 msgr2=0x7f8b9c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c06a290 0x7f8b9c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 -- 172.21.15.37:0/3557266415 >> v1:172.21.15.37:6789/0 conn(0x7f8b9c09b490 legacy=0x7f8b9c068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 -- 172.21.15.37:0/3557266415 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0c9720 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b99ffb700 1 -- 172.21.15.37:0/3557266415 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047115312 0 0) 0x7f8b9c0c9a50 con 0x7f8b9c09b490 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b9affd700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0cbf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009910 tx=0x7f8b940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b700c06c48b1edc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b99ffb700 1 -- 172.21.15.37:0/3557266415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400b8b0 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b99ffb700 1 -- 172.21.15.37:0/3557266415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400ba10 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.416+0000 7f8b99ffb700 1 -- 172.21.15.37:0/3557266415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400bdb0 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3557266415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c09b0c0 msgr2=0x7f8b9c0cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0cbf00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009910 tx=0x7f8b940091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3557266415 shutdown_connections 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c06a290 0x7f8b9c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3557266415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0cbf00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3557266415 >> 172.21.15.37:0/3557266415 conn(0x7f8b9c0680f0 msgr2=0x7f8b9c0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3557266415 shutdown_connections 2023-10-06T04:19:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.417+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3557266415 wait complete. 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.418+0000 7f8ba13ab700 1 Processor -- start 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.418+0000 7f8ba13ab700 1 -- start start 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 0x7f8b9c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c09b490 0x7f8b9c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c4340 con 0x7f8b9c06a290 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c1e40 con 0x7f8b9c09b0c0 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8ba13ab700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c4570 con 0x7f8b9c09b490 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 0x7f8b9c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 0x7f8b9c159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 -- 172.21.15.37:0/3472963160 learned_addr learned my addr 172.21.15.37:0/3472963160 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 -- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c09b490 msgr2=0x7f8b9c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9b7fe700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c09b490 0x7f8b9c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b9c09b490 0x7f8b9c0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9a7fc700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 -- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b9c09b0c0 msgr2=0x7f8b9c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.419+0000 7f8b9affd700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b9c09b0c0 0x7f8b9c0b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8b9affd700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b94009420 con 0x7f8b9c06a290 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8b9affd700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 0x7f8b9c159ac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400b3c0 tx=0x7f8b94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94024440 con 0x7f8b9c06a290 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b940245a0 con 0x7f8b9c06a290 2023-10-06T04:19:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0c4850 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94024960 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.420+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c15a000 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.421+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b9c04c3c0 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.421+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b94024d50 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b92ffd700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8b7c066f30 0x7f8b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8b94086120 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b9a7fc700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8b7c066f30 0x7f8b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b92ffd700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7f8b7c06d3a0 0x7f8b7c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b7c06fe80 con 0x7f8b7c06d3a0 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b94088700 con 0x7f8b9c06a290 2023-10-06T04:19:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b9b7fe700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7f8b7c06d3a0 0x7f8b7c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b9b7fe700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7f8b7c06d3a0 0x7f8b7c06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.422+0000 7f8b9a7fc700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8b7c066f30 0x7f8b7c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b84007fd0 tx=0x7f8b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.423+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== osd.0 v2:172.21.15.37:6808/90645 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8b7c06fe80 con 0x7f8b7c06d3a0 2023-10-06T04:19:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.437+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 --> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8b9c0cedf0 con 0x7f8b7c06d3a0 2023-10-06T04:19:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.437+0000 7f8b92ffd700 1 -- 172.21.15.37:0/3472963160 <== osd.0 v2:172.21.15.37:6808/90645 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8b9c0cedf0 con 0x7f8b7c06d3a0 2023-10-06T04:19:24.439 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:24.439 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:24.439 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7f8b7c06d3a0 msgr2=0x7f8b7c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:6808/90645,v1:172.21.15.37:6809/90645] conn(0x7f8b7c06d3a0 0x7f8b7c06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8b7c066f30 msgr2=0x7f8b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f8b7c066f30 0x7f8b7c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8b84007fd0 tx=0x7f8b84009040 comp rx=0 tx=0).stop 2023-10-06T04:19:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 msgr2=0x7f8b9c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 --2- 172.21.15.37:0/3472963160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c06a290 0x7f8b9c159ac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400b3c0 tx=0x7f8b94017000 comp rx=0 tx=0).stop 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8b9b7fe700 1 -- 172.21.15.37:0/3472963160 reap_dead start 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 shutdown_connections 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 >> 172.21.15.37:0/3472963160 conn(0x7f8b9c0680f0 msgr2=0x7f8b9c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 shutdown_connections 2023-10-06T04:19:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.438+0000 7f8ba13ab700 1 -- 172.21.15.37:0/3472963160 wait complete. 2023-10-06T04:19:24.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:19:24.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:24.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:24.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.570+0000 7fbc6b6d1700 1 Processor -- start 2023-10-06T04:19:24.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 -- start start 2023-10-06T04:19:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbc641598c0 0x7fbc64159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc640ca1a0 0x7fbc640b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc6406a6b0 0x7fbc6406ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6406b070 con 0x7fbc6406a6b0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6406f320 con 0x7fbc641598c0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc6b6d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640b1110 con 0x7fbc640ca1a0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.571+0000 7fbc69c6e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc6406a6b0 0x7fbc6406ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc6406a6b0 0x7fbc6406ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60430/0 (socket says 172.21.15.37:60430) 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 -- 172.21.15.37:0/2583090435 learned_addr learned my addr 172.21.15.37:0/2583090435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc68c6c700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc640ca1a0 0x7fbc640b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc6946d700 1 --2- 172.21.15.37:0/2583090435 >> v2:172.21.15.83:3300/0 conn(0x7fbc641598c0 0x7fbc64159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 -- 172.21.15.37:0/2583090435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc640ca1a0 msgr2=0x7fbc640b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc640ca1a0 0x7fbc640b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 -- 172.21.15.37:0/2583090435 >> v2:172.21.15.83:3300/0 conn(0x7fbc641598c0 msgr2=0x7fbc64159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 --2- 172.21.15.37:0/2583090435 >> v2:172.21.15.83:3300/0 conn(0x7fbc641598c0 0x7fbc64159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 -- 172.21.15.37:0/2583090435 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640ca610 con 0x7fbc6406a6b0 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc69c6e700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc6406ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbc64071280 tx=0x7fbc5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832dd7d0e0b265de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc63fff700 1 -- 172.21.15.37:0/2583090435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00b860 con 0x7fbc6406a6b0 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc63fff700 1 -- 172.21.15.37:0/2583090435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00b9c0 con 0x7fbc6406a6b0 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.572+0000 7fbc63fff700 1 -- 172.21.15.37:0/2583090435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00bd60 con 0x7fbc6406a6b0 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/2583090435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 msgr2=0x7fbc6406ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc6406ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbc64071280 tx=0x7fbc5c009250 comp rx=0 tx=0).stop 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/2583090435 shutdown_connections 2023-10-06T04:19:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc6406ab30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/2583090435 >> v2:172.21.15.83:3300/0 conn(0x7fbc641598c0 0x7fbc64159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/2583090435 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc640ca1a0 0x7fbc640b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/2583090435 >> 172.21.15.37:0/2583090435 conn(0x7fbc64068770 msgr2=0x7fbc64068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/2583090435 shutdown_connections 2023-10-06T04:19:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.573+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/2583090435 wait complete. 2023-10-06T04:19:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.574+0000 7fbc6b6d1700 1 Processor -- start 2023-10-06T04:19:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.574+0000 7fbc6b6d1700 1 -- start start 2023-10-06T04:19:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc640ca1a0 0x7fbc64158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc641598c0 0x7fbc6416a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc641590c0 con 0x7fbc6406a6b0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc641593a0 con 0x7fbc640ca1a0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6b6d1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64159680 con 0x7fbc641598c0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60434/0 (socket says 172.21.15.37:60434) 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 -- 172.21.15.37:0/3960271322 learned_addr learned my addr 172.21.15.37:0/3960271322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc68c6c700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc640ca1a0 0x7fbc64158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc69c6e700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc641598c0 0x7fbc6416a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 -- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc641598c0 msgr2=0x7fbc6416a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc641598c0 0x7fbc6416a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 -- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc640ca1a0 msgr2=0x7fbc64158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc640ca1a0 0x7fbc64158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 -- 172.21.15.37:0/3960271322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0094f0 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc6946d700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400e190 tx=0x7fbc54009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400ecd0 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.575+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400ee30 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.576+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc641698b0 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.576+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54014670 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.576+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc64158d90 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.576+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc64063410 con 0x7fbc6406a6b0 2023-10-06T04:19:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.577+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc54014a20 con 0x7fbc6406a6b0 2023-10-06T04:19:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.577+0000 7fbc617fa700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 0x7fbc500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.577+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbc54084a20 con 0x7fbc6406a6b0 2023-10-06T04:19:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.577+0000 7fbc68c6c700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 0x7fbc500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.578+0000 7fbc68c6c700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 0x7fbc500693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006fd0 tx=0x7fbc58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.581+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc54051e30 con 0x7fbc6406a6b0 2023-10-06T04:19:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.774+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc6406ea20 con 0x7fbc50066f30 2023-10-06T04:19:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.774+0000 7fbc617fa700 1 -- 172.21.15.37:0/3960271322 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc6406ea20 con 0x7fbc50066f30 2023-10-06T04:19:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 msgr2=0x7fbc500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 0x7fbc500693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006fd0 tx=0x7fbc58008040 comp rx=0 tx=0).stop 2023-10-06T04:19:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 msgr2=0x7fbc640c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400e190 tx=0x7fbc54009920 comp rx=0 tx=0).stop 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 shutdown_connections 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbc641598c0 0x7fbc6416a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc6406a6b0 0x7fbc640c7d70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fbc50066f30 0x7fbc500693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.776+0000 7fbc6b6d1700 1 --2- 172.21.15.37:0/3960271322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc640ca1a0 0x7fbc64158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.777+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 >> 172.21.15.37:0/3960271322 conn(0x7fbc64068770 msgr2=0x7fbc640ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.777+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 shutdown_connections 2023-10-06T04:19:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.777+0000 7fbc6b6d1700 1 -- 172.21.15.37:0/3960271322 wait complete. 2023-10-06T04:19:24.780 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:19:24.791 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:19:24.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.954+0000 7f79d3932700 1 Processor -- start 2023-10-06T04:19:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.954+0000 7f79d3932700 1 -- start start 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d3932700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15a0e0 0x7f79cc0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d3932700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79cc0cf5d0 0x7f79cc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d3932700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc0ce130 con 0x7f79cc15ab60 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d3932700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0cb4c0 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d3932700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0cd860 con 0x7f79cc15a0e0 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79cc0cf5d0 0x7f79cc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79cc0cf5d0 0x7f79cc0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60444/0 (socket says 172.21.15.37:60444) 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 -- 172.21.15.37:0/2984878483 learned_addr learned my addr 172.21.15.37:0/2984878483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:24.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d0ecd700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15a0e0 0x7f79cc0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 -- 172.21.15.37:0/2984878483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15a0e0 msgr2=0x7f79cc0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15a0e0 0x7f79cc0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 -- 172.21.15.37:0/2984878483 >> v1:172.21.15.83:6789/0 conn(0x7f79cc15ab60 legacy=0x7f79cc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 -- 172.21.15.37:0/2984878483 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0cb6b0 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79d1ecf700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc0cd320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009f20 tx=0x7f79c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a914b43e7912fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.955+0000 7f79cbfff700 1 -- 172.21.15.37:0/2984878483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400e070 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79cbfff700 1 -- 172.21.15.37:0/2984878483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400b9d0 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79cbfff700 1 -- 172.21.15.37:0/2984878483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40092e0 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 -- 172.21.15.37:0/2984878483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc0cf5d0 msgr2=0x7f79cc0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc0cd320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009f20 tx=0x7f79c4009840 comp rx=0 tx=0).stop 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 -- 172.21.15.37:0/2984878483 shutdown_connections 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc0cd320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 --2- 172.21.15.37:0/2984878483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15a0e0 0x7f79cc0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 -- 172.21.15.37:0/2984878483 >> 172.21.15.37:0/2984878483 conn(0x7f79cc099990 msgr2=0x7f79cc06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 -- 172.21.15.37:0/2984878483 shutdown_connections 2023-10-06T04:19:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.956+0000 7f79d3932700 1 -- 172.21.15.37:0/2984878483 wait complete. 2023-10-06T04:19:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.957+0000 7f79d3932700 1 Processor -- start 2023-10-06T04:19:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.957+0000 7f79d3932700 1 -- start start 2023-10-06T04:19:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 0x7f79cc1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15ab60 0x7f79cc16d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc16d050 con 0x7f79cc15a0e0 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc16cd20 con 0x7f79cc0cf5d0 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d3932700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c6d10 con 0x7f79cc15ab60 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d0ecd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 0x7f79cc1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d0ecd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 0x7f79cc1523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60454/0 (socket says 172.21.15.37:60454) 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d0ecd700 1 -- 172.21.15.37:0/3277397582 learned_addr learned my addr 172.21.15.37:0/3277397582 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d1ecf700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15ab60 0x7f79cc16d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d16ce700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d0ecd700 1 -- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15ab60 msgr2=0x7f79cc16d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.958+0000 7f79d0ecd700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79cc15ab60 0x7f79cc16d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d0ecd700 1 -- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79cc0cf5d0 msgr2=0x7f79cc152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d0ecd700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79cc0cf5d0 0x7f79cc152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d0ecd700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009ae0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d0ecd700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 0x7f79cc1523c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e930 tx=0x7f79c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0013680 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c00137e0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0c6ff0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0013b80 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.959+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc152900 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.960+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79cc04c3c0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.960+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79c000c3e0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79c97fa700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f79b8066f30 0x7f79b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f79c0084480 con 0x7f79cc15a0e0 2023-10-06T04:19:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79c97fa700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f79b806d3a0 0x7f79b806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79b806fe80 con 0x7f79b806d3a0 2023-10-06T04:19:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79d16ce700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f79b8066f30 0x7f79b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c0086ac0 con 0x7f79cc15a0e0 2023-10-06T04:19:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79d1ecf700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f79b806d3a0 0x7f79b806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79d1ecf700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f79b806d3a0 0x7f79b806f7b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.961+0000 7f79d16ce700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f79b8066f30 0x7f79b80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f79bc003a80 tx=0x7f79bc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.962+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== osd.1 v2:172.21.15.37:6800/90646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f79b806fe80 con 0x7f79b806d3a0 2023-10-06T04:19:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.976+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 --> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79cc067f70 con 0x7f79b806d3a0 2023-10-06T04:19:24.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.976+0000 7f79c97fa700 1 -- 172.21.15.37:0/3277397582 <== osd.1 v2:172.21.15.37:6800/90646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f79cc067f70 con 0x7f79b806d3a0 2023-10-06T04:19:24.978 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:24.978 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:24.978 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.976+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f79b806d3a0 msgr2=0x7f79b806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.976+0000 7f79d3932700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:6800/90646,v1:172.21.15.37:6801/90646] conn(0x7f79b806d3a0 0x7f79b806f7b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f79b8066f30 msgr2=0x7f79b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f79b8066f30 0x7f79b80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f79bc003a80 tx=0x7f79bc007ec0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 msgr2=0x7f79cc1523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 --2- 172.21.15.37:0/3277397582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79cc15a0e0 0x7f79cc1523c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79c000e930 tx=0x7f79c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d1ecf700 1 -- 172.21.15.37:0/3277397582 reap_dead start 2023-10-06T04:19:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 shutdown_connections 2023-10-06T04:19:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 >> 172.21.15.37:0/3277397582 conn(0x7f79cc099990 msgr2=0x7f79cc0ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 shutdown_connections 2023-10-06T04:19:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:24.977+0000 7f79d3932700 1 -- 172.21.15.37:0/3277397582 wait complete. 2023-10-06T04:19:24.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:19:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.108+0000 7f0261b9d700 1 Processor -- start 2023-10-06T04:19:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.108+0000 7f0261b9d700 1 -- start start 2023-10-06T04:19:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f0261b9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c0b3740 0x7f025c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f0261b9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f025c0cfbb0 0x7f025c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f0261b9d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0b6530 con 0x7f025c0aaea0 2023-10-06T04:19:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f0261b9d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0ce710 con 0x7f025c0b3740 2023-10-06T04:19:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f0261b9d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c159e20 con 0x7f025c0cfbb0 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f025b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c0b3740 0x7f025c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f025b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f025c0b3740 0x7f025c0b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60462/0 (socket says 172.21.15.37:60462) 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f025b7fe700 1 -- 172.21.15.37:0/1497991678 learned_addr learned my addr 172.21.15.37:0/1497991678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.109+0000 7f025bfff700 1 --2- 172.21.15.37:0/1497991678 >> v2:172.21.15.83:3300/0 conn(0x7f025c0cfbb0 0x7f025c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025b7fe700 1 -- 172.21.15.37:0/1497991678 >> v2:172.21.15.83:3300/0 conn(0x7f025c0cfbb0 msgr2=0x7f025c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025b7fe700 1 --2- 172.21.15.37:0/1497991678 >> v2:172.21.15.83:3300/0 conn(0x7f025c0cfbb0 0x7f025c0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025b7fe700 1 -- 172.21.15.37:0/1497991678 >> v1:172.21.15.83:6789/0 conn(0x7f025c0aaea0 legacy=0x7f025c0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025b7fe700 1 -- 172.21.15.37:0/1497991678 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0cdb00 con 0x7f025c0b3740 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025b7fe700 1 --2- 172.21.15.37:0/1497991678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0b3740 0x7f025c0b3b10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f025c0cda10 tx=0x7f024c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11a6de037e0259a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025a7fc700 1 -- 172.21.15.37:0/1497991678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c005c10 con 0x7f025c0b3740 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025a7fc700 1 -- 172.21.15.37:0/1497991678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c005d70 con 0x7f025c0b3740 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f025a7fc700 1 -- 172.21.15.37:0/1497991678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00b840 con 0x7f025c0b3740 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 -- 172.21.15.37:0/1497991678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0b3740 msgr2=0x7f025c0b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 --2- 172.21.15.37:0/1497991678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0b3740 0x7f025c0b3b10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f025c0cda10 tx=0x7f024c009220 comp rx=0 tx=0).stop 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 -- 172.21.15.37:0/1497991678 shutdown_connections 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 --2- 172.21.15.37:0/1497991678 >> v2:172.21.15.83:3300/0 conn(0x7f025c0cfbb0 0x7f025c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 --2- 172.21.15.37:0/1497991678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0b3740 0x7f025c0b3b10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.110+0000 7f0261b9d700 1 -- 172.21.15.37:0/1497991678 >> 172.21.15.37:0/1497991678 conn(0x7f025c099a10 msgr2=0x7f025c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.111+0000 7f0261b9d700 1 -- 172.21.15.37:0/1497991678 shutdown_connections 2023-10-06T04:19:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.111+0000 7f0261b9d700 1 -- 172.21.15.37:0/1497991678 wait complete. 2023-10-06T04:19:25.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 Processor -- start 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 -- start start 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 0x7f025c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b3740 0x7f025c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c150d90 con 0x7f025c0cfbb0 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1503e0 con 0x7f025c0b3740 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.112+0000 7f0261b9d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c153d00 con 0x7f025c0aaea0 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60468/0 (socket says 172.21.15.37:60468) 2023-10-06T04:19:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 -- 172.21.15.37:0/2076695150 learned_addr learned my addr 172.21.15.37:0/2076695150 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 0x7f025c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025affd700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b3740 0x7f025c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 -- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 msgr2=0x7f025c14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 0x7f025c14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 -- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b3740 msgr2=0x7f025c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b3740 0x7f025c15d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 -- 172.21.15.37:0/2076695150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009480 con 0x7f025c0cfbb0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 0x7f025c14fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f025bfff700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0254009fa0 tx=0x7f0254009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400ed20 con 0x7f025c0cfbb0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400ee80 con 0x7f025c0cfbb0 2023-10-06T04:19:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0b0ba0 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254014670 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.113+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0b0550 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.114+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c063410 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.115+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0254014a20 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.115+0000 7f02437fe700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.115+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0254084ac0 con 0x7f025c0cfbb0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.115+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.116+0000 7f025b7fe700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f024c0030c0 tx=0x7f024c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.119+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0254051ed0 con 0x7f025c0cfbb0 2023-10-06T04:19:25.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.315+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f025c0b2ef0 con 0x7f0248066f30 2023-10-06T04:19:25.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.316+0000 7f02437fe700 1 -- 172.21.15.37:0/2076695150 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f025c0b2ef0 con 0x7f0248066f30 2023-10-06T04:19:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 msgr2=0x7f02480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f024c0030c0 tx=0x7f024c015000 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 msgr2=0x7f025c0b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0254009fa0 tx=0x7f0254009900 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 shutdown_connections 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f025c0cfbb0 0x7f025c0b1030 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f025c0aaea0 0x7f025c14fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f0248066f30 0x7f02480693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 --2- 172.21.15.37:0/2076695150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f025c0b3740 0x7f025c15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 >> 172.21.15.37:0/2076695150 conn(0x7f025c099a10 msgr2=0x7f025c15f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 shutdown_connections 2023-10-06T04:19:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.318+0000 7f0261b9d700 1 -- 172.21.15.37:0/2076695150 wait complete. 2023-10-06T04:19:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:19:25.331 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:19:25.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:25.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 Processor -- start 2023-10-06T04:19:25.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 -- start start 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9e5015a0a0 0x7f9e500ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500ce130 con 0x7f9e500cf5d0 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500cb6b0 con 0x7f9e5015ab20 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.453+0000 7f9e54c5a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500cb4c0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4ed9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e500cf5d0 0x7f9e501635f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37946/0 (socket says 172.21.15.37:37946) 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4ed9d700 1 -- 172.21.15.37:0/2664446982 learned_addr learned my addr 172.21.15.37:0/2664446982 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4dd9b700 1 --2- 172.21.15.37:0/2664446982 >> v2:172.21.15.83:3300/0 conn(0x7f9e5015a0a0 0x7f9e500ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4d59a700 1 -- 172.21.15.37:0/2664446982 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661190637 0 0) 0x7f9e500ce130 con 0x7f9e500cf5d0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4d59a700 1 -- 172.21.15.37:0/2664446982 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3c003570 con 0x7f9e500cf5d0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/2664446982 >> v1:172.21.15.83:6789/0 conn(0x7f9e5015ab20 legacy=0x7f9e500cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/2664446982 >> v1:172.21.15.37:6789/0 conn(0x7f9e500cf5d0 legacy=0x7f9e501635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/2664446982 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500cb990 con 0x7f9e5015a0a0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4dd9b700 1 --2- 172.21.15.37:0/2664446982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015a0a0 0x7f9e500ccde0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098e0 tx=0x7f9e380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f01f42796828407 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.454+0000 7f9e4d59a700 1 -- 172.21.15.37:0/2664446982 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800b640 con 0x7f9e5015a0a0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e4d59a700 1 -- 172.21.15.37:0/2664446982 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3800b7a0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e4d59a700 1 -- 172.21.15.37:0/2664446982 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800bb40 con 0x7f9e5015a0a0 2023-10-06T04:19:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 -- 172.21.15.37:0/2664446982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015a0a0 msgr2=0x7f9e500ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 --2- 172.21.15.37:0/2664446982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015a0a0 0x7f9e500ccde0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098e0 tx=0x7f9e380091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 -- 172.21.15.37:0/2664446982 shutdown_connections 2023-10-06T04:19:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 --2- 172.21.15.37:0/2664446982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015a0a0 0x7f9e500ccde0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 -- 172.21.15.37:0/2664446982 >> 172.21.15.37:0/2664446982 conn(0x7f9e50099990 msgr2=0x7f9e5006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 -- 172.21.15.37:0/2664446982 shutdown_connections 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.455+0000 7f9e54c5a700 1 -- 172.21.15.37:0/2664446982 wait complete. 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.456+0000 7f9e54c5a700 1 Processor -- start 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.456+0000 7f9e54c5a700 1 -- start start 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e500cf5d0 0x7f9e50152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 0x7f9e500696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015ab20 0x7f9e50069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500c9450 con 0x7f9e5015a0a0 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5009de40 con 0x7f9e5015ab20 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e54c5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5009d290 con 0x7f9e500cf5d0 2023-10-06T04:19:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 0x7f9e500696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 0x7f9e500696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60474/0 (socket says 172.21.15.37:60474) 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/512024594 learned_addr learned my addr 172.21.15.37:0/512024594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4ed9d700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015ab20 0x7f9e50069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4e59c700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e500cf5d0 0x7f9e50152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e500cf5d0 msgr2=0x7f9e50152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e500cf5d0 0x7f9e50152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015ab20 msgr2=0x7f9e50069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e5015ab20 0x7f9e50069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38009420 con 0x7f9e5015a0a0 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.457+0000 7f9e4dd9b700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 0x7f9e500696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009f80 tx=0x7f9e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.458+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800bb20 con 0x7f9e5015a0a0 2023-10-06T04:19:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.458+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38011420 con 0x7f9e5015a0a0 2023-10-06T04:19:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.458+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5009d510 con 0x7f9e5015a0a0 2023-10-06T04:19:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.458+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380117a0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.458+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5009dad0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.459+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e5004c3c0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.459+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e38011b10 con 0x7f9e5015a0a0 2023-10-06T04:19:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.459+0000 7f9e467fc700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9e30066f30 0x7f9e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9e38085ad0 con 0x7f9e5015a0a0 2023-10-06T04:19:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e467fc700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7f9e3006d3a0 0x7f9e3006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e3006fe80 con 0x7f9e3006d3a0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e3808a240 con 0x7f9e5015a0a0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e4e59c700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9e30066f30 0x7f9e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e4ed9d700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7f9e3006d3a0 0x7f9e3006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e4ed9d700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7f9e3006d3a0 0x7f9e3006f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.460+0000 7f9e4e59c700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9e30066f30 0x7f9e300693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007fd0 tx=0x7f9e40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.461+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== osd.2 v2:172.21.15.37:6816/90657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9e3006fe80 con 0x7f9e3006d3a0 2023-10-06T04:19:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.474+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 --> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e500c71a0 con 0x7f9e3006d3a0 2023-10-06T04:19:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e467fc700 1 -- 172.21.15.37:0/512024594 <== osd.2 v2:172.21.15.37:6816/90657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9e500c71a0 con 0x7f9e3006d3a0 2023-10-06T04:19:25.476 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:25.477 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:25.477 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7f9e3006d3a0 msgr2=0x7f9e3006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:6816/90657,v1:172.21.15.37:6817/90657] conn(0x7f9e3006d3a0 0x7f9e3006f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9e30066f30 msgr2=0x7f9e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f9e30066f30 0x7f9e300693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007fd0 tx=0x7f9e40009040 comp rx=0 tx=0).stop 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 msgr2=0x7f9e500696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 --2- 172.21.15.37:0/512024594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5015a0a0 0x7f9e500696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009f80 tx=0x7f9e38017000 comp rx=0 tx=0).stop 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e4ed9d700 1 -- 172.21.15.37:0/512024594 reap_dead start 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 shutdown_connections 2023-10-06T04:19:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 >> 172.21.15.37:0/512024594 conn(0x7f9e50099990 msgr2=0x7f9e500b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 shutdown_connections 2023-10-06T04:19:25.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.475+0000 7f9e54c5a700 1 -- 172.21.15.37:0/512024594 wait complete. 2023-10-06T04:19:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:19:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.607+0000 7f3f66fa2700 1 Processor -- start 2023-10-06T04:19:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.607+0000 7f3f66fa2700 1 -- start start 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f66fa2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f600b2810 0x7f3f600cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f66fa2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600ccb90 0x7f3f600ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f66fa2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f600cf460 con 0x7f3f600cb470 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f66fa2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f600cfe30 con 0x7f3f600b2810 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f66fa2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60159b20 con 0x7f3f600ccb90 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f600b2810 0x7f3f600cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f600b2810 0x7f3f600cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60490/0 (socket says 172.21.15.37:60490) 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 -- 172.21.15.37:0/4202837961 learned_addr learned my addr 172.21.15.37:0/4202837961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f667a1700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600ccb90 0x7f3f600ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 -- 172.21.15.37:0/4202837961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600ccb90 msgr2=0x7f3f600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600ccb90 0x7f3f600ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 -- 172.21.15.37:0/4202837961 >> v1:172.21.15.83:6789/0 conn(0x7f3f600cb470 legacy=0x7f3f6015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f64f9e700 1 -- 172.21.15.37:0/4202837961 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880740871 0 0) 0x7f3f600cf460 con 0x7f3f600cb470 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 -- 172.21.15.37:0/4202837961 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600ce890 con 0x7f3f600b2810 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.608+0000 7f3f65fa0700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600b2810 0x7f3f600cf8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099e0 tx=0x7f3f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6cd3095d879e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f64f9e700 1 -- 172.21.15.37:0/4202837961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00b820 con 0x7f3f600b2810 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f64f9e700 1 -- 172.21.15.37:0/4202837961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00b980 con 0x7f3f600b2810 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f64f9e700 1 -- 172.21.15.37:0/4202837961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00bd20 con 0x7f3f600b2810 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 -- 172.21.15.37:0/4202837961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600b2810 msgr2=0x7f3f600cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600b2810 0x7f3f600cf8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099e0 tx=0x7f3f5c009250 comp rx=0 tx=0).stop 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 -- 172.21.15.37:0/4202837961 shutdown_connections 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600ccb90 0x7f3f600ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/4202837961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600b2810 0x7f3f600cf8f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 -- 172.21.15.37:0/4202837961 >> 172.21.15.37:0/4202837961 conn(0x7f3f6006ed90 msgr2=0x7f3f6006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 -- 172.21.15.37:0/4202837961 shutdown_connections 2023-10-06T04:19:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.609+0000 7f3f66fa2700 1 -- 172.21.15.37:0/4202837961 wait complete. 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.610+0000 7f3f66fa2700 1 Processor -- start 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.610+0000 7f3f66fa2700 1 -- start start 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600b2810 0x7f3f60145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f600cb470 0x7f3f600c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6016ae80 con 0x7f3f600ccb90 2023-10-06T04:19:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60145da0 con 0x7f3f600cb470 2023-10-06T04:19:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f66fa2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6016ab20 con 0x7f3f600b2810 2023-10-06T04:19:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60504/0 (socket says 172.21.15.37:60504) 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 -- 172.21.15.37:0/375084847 learned_addr learned my addr 172.21.15.37:0/375084847 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f65fa0700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600b2810 0x7f3f60145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f6579f700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f600cb470 0x7f3f600c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 -- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600b2810 msgr2=0x7f3f60145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600b2810 0x7f3f60145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 -- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f600cb470 msgr2=0x7f3f600c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.611+0000 7f3f667a1700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f600cb470 0x7f3f600c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f667a1700 1 -- 172.21.15.37:0/375084847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0094f0 con 0x7f3f600ccb90 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f667a1700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009df0 tx=0x7f3f5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800caa0 con 0x7f3f600ccb90 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5800f040 con 0x7f3f600ccb90 2023-10-06T04:19:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f600c9870 con 0x7f3f600ccb90 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800ce70 con 0x7f3f600ccb90 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.612+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f600c9e30 con 0x7f3f600ccb90 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.613+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6004c3c0 con 0x7f3f600ccb90 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.613+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f58014690 con 0x7f3f600ccb90 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.614+0000 7f3f55ffb700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 0x7f3f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.614+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3f58084f00 con 0x7f3f600ccb90 2023-10-06T04:19:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.614+0000 7f3f65fa0700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 0x7f3f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.614+0000 7f3f65fa0700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 0x7f3f440693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099e0 tx=0x7f3f5c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.618+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f58055da0 con 0x7f3f600ccb90 2023-10-06T04:19:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.811+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f600ceb30 con 0x7f3f44066f30 2023-10-06T04:19:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.811+0000 7f3f55ffb700 1 -- 172.21.15.37:0/375084847 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3f600ceb30 con 0x7f3f44066f30 2023-10-06T04:19:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 msgr2=0x7f3f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 0x7f3f440693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099e0 tx=0x7f3f5c017000 comp rx=0 tx=0).stop 2023-10-06T04:19:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 msgr2=0x7f3f60169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009df0 tx=0x7f3f5800b040 comp rx=0 tx=0).stop 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 shutdown_connections 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600ccb90 0x7f3f60169a60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f600b2810 0x7f3f60145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3f44066f30 0x7f3f440693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 --2- 172.21.15.37:0/375084847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f600cb470 0x7f3f600c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.813+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 >> 172.21.15.37:0/375084847 conn(0x7f3f6006ed90 msgr2=0x7f3f60158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.814+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 shutdown_connections 2023-10-06T04:19:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.814+0000 7f3f66fa2700 1 -- 172.21.15.37:0/375084847 wait complete. 2023-10-06T04:19:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:19:25.827 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:19:25.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.949+0000 7fb03484b700 1 Processor -- start 2023-10-06T04:19:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.949+0000 7fb03484b700 1 -- start start 2023-10-06T04:19:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb03484b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0300b2650 0x7fb0300cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb03484b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b0c50 0x7fb0300d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb03484b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300ccad0 con 0x7fb0300b2a20 2023-10-06T04:19:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb03484b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0300d0f10 con 0x7fb0300b2650 2023-10-06T04:19:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb03484b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300cddd0 con 0x7fb0300b0c50 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0300b2650 0x7fb0300cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0300b2650 0x7fb0300cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60508/0 (socket says 172.21.15.37:60508) 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 -- 172.21.15.37:0/3874384894 learned_addr learned my addr 172.21.15.37:0/3874384894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02effd700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b0c50 0x7fb0300d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 -- 172.21.15.37:0/3874384894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b0c50 msgr2=0x7fb0300d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b0c50 0x7fb0300d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 -- 172.21.15.37:0/3874384894 >> v1:172.21.15.83:6789/0 conn(0x7fb0300b2a20 legacy=0x7fb030159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.950+0000 7fb02f7fe700 1 -- 172.21.15.37:0/3874384894 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300ccdb0 con 0x7fb0300b2650 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb02f7fe700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b2650 0x7fb0300cd890 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb0200099b0 tx=0x7fb020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b954346bacfdbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb02e7fc700 1 -- 172.21.15.37:0/3874384894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000b860 con 0x7fb0300b2650 2023-10-06T04:19:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb02e7fc700 1 -- 172.21.15.37:0/3874384894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000b9c0 con 0x7fb0300b2650 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb02e7fc700 1 -- 172.21.15.37:0/3874384894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bd60 con 0x7fb0300b2650 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 -- 172.21.15.37:0/3874384894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b2650 msgr2=0x7fb0300cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b2650 0x7fb0300cd890 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb0200099b0 tx=0x7fb020009250 comp rx=0 tx=0).stop 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 -- 172.21.15.37:0/3874384894 shutdown_connections 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b2650 0x7fb0300cd890 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 --2- 172.21.15.37:0/3874384894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b0c50 0x7fb0300d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 -- 172.21.15.37:0/3874384894 >> 172.21.15.37:0/3874384894 conn(0x7fb03006ed90 msgr2=0x7fb03006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 -- 172.21.15.37:0/3874384894 shutdown_connections 2023-10-06T04:19:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.951+0000 7fb03484b700 1 -- 172.21.15.37:0/3874384894 wait complete. 2023-10-06T04:19:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 Processor -- start 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 -- start start 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 0x7fb030149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b2650 0x7fb0300c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0300b2a20 0x7fb0300c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c9750 con 0x7fb0300b0c50 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c8b40 con 0x7fb0300b2a20 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb03484b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300c8e20 con 0x7fb0300b2650 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb02f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 0x7fb030149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb02f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 0x7fb030149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60520/0 (socket says 172.21.15.37:60520) 2023-10-06T04:19:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb02f7fe700 1 -- 172.21.15.37:0/1823648281 learned_addr learned my addr 172.21.15.37:0/1823648281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb02effd700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b2650 0x7fb0300c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.953+0000 7fb02ffff700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0300b2a20 0x7fb0300c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 -- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b2650 msgr2=0x7fb0300c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb0300b2650 0x7fb0300c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 -- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0300b2a20 msgr2=0x7fb0300c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb0300b2a20 0x7fb0300c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200094f0 con 0x7fb0300b0c50 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb02f7fe700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 0x7fb030149a50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb0300683e0 tx=0x7fb020017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020011e40 con 0x7fb0300b0c50 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020024440 con 0x7fb0300b0c50 2023-10-06T04:19:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300c9100 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020024800 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.954+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb030149f90 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.955+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb03004c3c0 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.955+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb02001a420 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb0177fe700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb01c066f30 0x7fb01c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb020086250 con 0x7fb0300b0c50 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb0177fe700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fb01c06d3a0 0x7fb01c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb01c06fe80 con 0x7fb01c06d3a0 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0200887b0 con 0x7fb0300b0c50 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb02effd700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb01c066f30 0x7fb01c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb02ffff700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fb01c06d3a0 0x7fb01c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.956+0000 7fb02ffff700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fb01c06d3a0 0x7fb01c06f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.957+0000 7fb02effd700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb01c066f30 0x7fb01c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb0300c6e30 tx=0x7fb024008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.957+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== osd.3 v2:172.21.15.37:6821/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb01c06fe80 con 0x7fb01c06d3a0 2023-10-06T04:19:25.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.971+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 --> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0300cabf0 con 0x7fb01c06d3a0 2023-10-06T04:19:25.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.971+0000 7fb0177fe700 1 -- 172.21.15.37:0/1823648281 <== osd.3 v2:172.21.15.37:6821/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0300cabf0 con 0x7fb01c06d3a0 2023-10-06T04:19:25.973 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:25.973 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:25.973 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:25.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.971+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fb01c06d3a0 msgr2=0x7fb01c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.971+0000 7fb03484b700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:6821/90670,v1:172.21.15.37:6823/90670] conn(0x7fb01c06d3a0 0x7fb01c06f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:25.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.971+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb01c066f30 msgr2=0x7fb01c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fb01c066f30 0x7fb01c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb0300c6e30 tx=0x7fb024008040 comp rx=0 tx=0).stop 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 msgr2=0x7fb030149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 --2- 172.21.15.37:0/1823648281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0300b0c50 0x7fb030149a50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb0300683e0 tx=0x7fb020017000 comp rx=0 tx=0).stop 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb02ffff700 1 -- 172.21.15.37:0/1823648281 reap_dead start 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 shutdown_connections 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 >> 172.21.15.37:0/1823648281 conn(0x7fb03006ed90 msgr2=0x7fb03015b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 shutdown_connections 2023-10-06T04:19:25.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:25.972+0000 7fb03484b700 1 -- 172.21.15.37:0/1823648281 wait complete. 2023-10-06T04:19:25.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:19:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.102+0000 7f5432d55700 1 Processor -- start 2023-10-06T04:19:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.102+0000 7f5432d55700 1 -- start start 2023-10-06T04:19:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5432d55700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f542c0b5e30 0x7f542c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5432d55700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f542c0ad800 0x7f542c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5432d55700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0ae9f0 con 0x7f542c0b6200 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5432d55700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0adde0 con 0x7f542c0b5e30 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5432d55700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0ae0c0 con 0x7f542c0ad800 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f5430af1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f542c0b5e30 0x7f542c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f542bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f542c0b6200 0x7f542c0ad0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37948/0 (socket says 172.21.15.37:37948) 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f542bfff700 1 -- 172.21.15.37:0/2116334133 learned_addr learned my addr 172.21.15.37:0/2116334133 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.103+0000 7f54312f2700 1 --2- 172.21.15.37:0/2116334133 >> v2:172.21.15.83:3300/0 conn(0x7f542c0ad800 0x7f542c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5430af1700 1 -- 172.21.15.37:0/2116334133 >> v2:172.21.15.83:3300/0 conn(0x7f542c0ad800 msgr2=0x7f542c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5430af1700 1 --2- 172.21.15.37:0/2116334133 >> v2:172.21.15.83:3300/0 conn(0x7f542c0ad800 0x7f542c15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5430af1700 1 -- 172.21.15.37:0/2116334133 >> v1:172.21.15.37:6789/0 conn(0x7f542c0b6200 legacy=0x7f542c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5430af1700 1 -- 172.21.15.37:0/2116334133 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0ae3a0 con 0x7f542c0b5e30 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5430af1700 1 --2- 172.21.15.37:0/2116334133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b5e30 0x7f542c15d560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f542c0adc80 tx=0x7f541c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932ff41d95ca0b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f542b7fe700 1 -- 172.21.15.37:0/2116334133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00e070 con 0x7f542c0b5e30 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f542b7fe700 1 -- 172.21.15.37:0/2116334133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00bc30 con 0x7f542c0b5e30 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f542b7fe700 1 -- 172.21.15.37:0/2116334133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c012430 con 0x7f542c0b5e30 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 -- 172.21.15.37:0/2116334133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b5e30 msgr2=0x7f542c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 --2- 172.21.15.37:0/2116334133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b5e30 0x7f542c15d560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f542c0adc80 tx=0x7f541c009780 comp rx=0 tx=0).stop 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 -- 172.21.15.37:0/2116334133 shutdown_connections 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 --2- 172.21.15.37:0/2116334133 >> v2:172.21.15.83:3300/0 conn(0x7f542c0ad800 0x7f542c15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 --2- 172.21.15.37:0/2116334133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b5e30 0x7f542c15d560 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.104+0000 7f5432d55700 1 -- 172.21.15.37:0/2116334133 >> 172.21.15.37:0/2116334133 conn(0x7f542c099a10 msgr2=0x7f542c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.105+0000 7f5432d55700 1 -- 172.21.15.37:0/2116334133 shutdown_connections 2023-10-06T04:19:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.105+0000 7f5432d55700 1 -- 172.21.15.37:0/2116334133 wait complete. 2023-10-06T04:19:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 Processor -- start 2023-10-06T04:19:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 -- start start 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f542c0ad800 0x7f542c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f542c0b5e30 0x7f542c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.106+0000 7f5432d55700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c151250 con 0x7f542c0b6200 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5432d55700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b3620 con 0x7f542c0ad800 2023-10-06T04:19:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5432d55700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b4480 con 0x7f542c0b5e30 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60540/0 (socket says 172.21.15.37:60540) 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 -- 172.21.15.37:0/2370245294 learned_addr learned my addr 172.21.15.37:0/2370245294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f542bfff700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f542c0b5e30 0x7f542c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5430af1700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f542c0ad800 0x7f542c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 -- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f542c0b5e30 msgr2=0x7f542c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f542c0b5e30 0x7f542c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 -- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f542c0ad800 msgr2=0x7f542c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f542c0ad800 0x7f542c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 -- 172.21.15.37:0/2370245294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009a20 con 0x7f542c0b6200 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f54312f2700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f542400d8c0 tx=0x7f5424008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240125f0 con 0x7f542c0b6200 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424012770 con 0x7f542c0b6200 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424012b30 con 0x7f542c0b6200 2023-10-06T04:19:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c0b3870 con 0x7f542c0b6200 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.107+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c0b3e30 con 0x7f542c0b6200 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.108+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0b2f90 con 0x7f542c0b6200 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.109+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f542401e460 con 0x7f542c0b6200 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.109+0000 7f5428ff9700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 0x7f54180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.109+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f54240848b0 con 0x7f542c0b6200 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.109+0000 7f5430af1700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 0x7f54180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.110+0000 7f5430af1700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 0x7f54180693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f541c009fd0 tx=0x7f541c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.113+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5424051cc0 con 0x7f542c0b6200 2023-10-06T04:19:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.306+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f542c0b45c0 con 0x7f5418066f30 2023-10-06T04:19:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.307+0000 7f5428ff9700 1 -- 172.21.15.37:0/2370245294 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f541c0032f0 con 0x7f5418066f30 2023-10-06T04:19:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 msgr2=0x7f54180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 0x7f54180693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f541c009fd0 tx=0x7f541c019000 comp rx=0 tx=0).stop 2023-10-06T04:19:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 msgr2=0x7f542c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f542400d8c0 tx=0x7f5424008040 comp rx=0 tx=0).stop 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 shutdown_connections 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b6200 0x7f542c154720 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f5418066f30 0x7f54180693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f542c0ad800 0x7f542c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 --2- 172.21.15.37:0/2370245294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f542c0b5e30 0x7f542c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 >> 172.21.15.37:0/2370245294 conn(0x7f542c099a10 msgr2=0x7f542c15d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 shutdown_connections 2023-10-06T04:19:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.309+0000 7f5432d55700 1 -- 172.21.15.37:0/2370245294 wait complete. 2023-10-06T04:19:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:19:26.322 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:19:26.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.444+0000 7f75f1235700 1 Processor -- start 2023-10-06T04:19:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.444+0000 7f75f1235700 1 -- start start 2023-10-06T04:19:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 0x7f75ec0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75ec0cd320 0x7f75ec0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0ce130 con 0x7f75ec0cd320 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0cb6b0 con 0x7f75ec15ab20 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75f1235700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0cb990 con 0x7f75ec15a0a0 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75ec0cd320 0x7f75ec0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75ec0cd320 0x7f75ec0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56356/0 (socket says 172.21.15.37:56356) 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 -- 172.21.15.37:0/2233865500 learned_addr learned my addr 172.21.15.37:0/2233865500 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75ead9d700 1 --2- 172.21.15.37:0/2233865500 >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 0x7f75ec0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75ea59c700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 -- 172.21.15.37:0/2233865500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 msgr2=0x7f75ec0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 -- 172.21.15.37:0/2233865500 >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 msgr2=0x7f75ec0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 --2- 172.21.15.37:0/2233865500 >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 0x7f75ec0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75eb59e700 1 -- 172.21.15.37:0/2233865500 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0cbc70 con 0x7f75ec0cd320 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75ea59c700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.445+0000 7f75ead9d700 1 --2- 172.21.15.37:0/2233865500 >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 0x7f75ec0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75eb59e700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0cd320 0x7f75ec0ce5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f75ec089820 tx=0x7f75e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc9e36477b9df5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2233865500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400e070 con 0x7f75ec0cd320 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2233865500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e400ba50 con 0x7f75ec0cd320 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2233865500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40092e0 con 0x7f75ec0cd320 2023-10-06T04:19:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 -- 172.21.15.37:0/2233865500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0cd320 msgr2=0x7f75ec0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0cd320 0x7f75ec0ce5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f75ec089820 tx=0x7f75e4009840 comp rx=0 tx=0).stop 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 -- 172.21.15.37:0/2233865500 shutdown_connections 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0cd320 0x7f75ec0ce5c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 --2- 172.21.15.37:0/2233865500 >> v2:172.21.15.83:3300/0 conn(0x7f75ec15ab20 0x7f75ec0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 --2- 172.21.15.37:0/2233865500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 -- 172.21.15.37:0/2233865500 >> 172.21.15.37:0/2233865500 conn(0x7f75ec099990 msgr2=0x7f75ec06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 -- 172.21.15.37:0/2233865500 shutdown_connections 2023-10-06T04:19:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.446+0000 7f75f1235700 1 -- 172.21.15.37:0/2233865500 wait complete. 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.447+0000 7f75f1235700 1 Processor -- start 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 -- start start 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75ec0cd320 0x7f75ec153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 0x7f75ec155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0ca580 con 0x7f75ec15ab20 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec09c720 con 0x7f75ec0cd320 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75f1235700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec09c130 con 0x7f75ec15a0a0 2023-10-06T04:19:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75eb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 0x7f75ec155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75eb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 0x7f75ec155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56364/0 (socket says 172.21.15.37:56364) 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75eb59e700 1 -- 172.21.15.37:0/3341936504 learned_addr learned my addr 172.21.15.37:0/3341936504 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75ea59c700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.448+0000 7f75ead9d700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75ec0cd320 0x7f75ec153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 -- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 msgr2=0x7f75ec153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 -- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75ec0cd320 msgr2=0x7f75ec153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75ec0cd320 0x7f75ec153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009ae0 con 0x7f75ec15ab20 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75ea59c700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75ec15a0a0 0x7f75ec153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75ead9d700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75ec0cd320 0x7f75ec153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75eb59e700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 0x7f75ec155a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009fd0 tx=0x7f75e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40032f0 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4008e70 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec0ca000 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e401c620 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.449+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec09c3b0 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.450+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75ec04c3c0 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.450+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75e4003040 con 0x7f75ec15ab20 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75e2ffd700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75cc066f30 0x7f75cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f75e4085da0 con 0x7f75ec15ab20 2023-10-06T04:19:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75e2ffd700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7f75cc06d3a0 0x7f75cc06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75ead9d700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75cc066f30 0x7f75cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75cc06fe80 con 0x7f75cc06d3a0 2023-10-06T04:19:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75e40883e0 con 0x7f75ec15ab20 2023-10-06T04:19:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75ea59c700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7f75cc06d3a0 0x7f75cc06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.451+0000 7f75ead9d700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75cc066f30 0x7f75cc0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0cd7e0 tx=0x7f75dc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.452+0000 7f75ea59c700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7f75cc06d3a0 0x7f75cc06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.452+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== osd.4 v2:172.21.15.83:6800/90892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f75cc06fe80 con 0x7f75cc06d3a0 2023-10-06T04:19:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.466+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 --> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75ec157860 con 0x7f75cc06d3a0 2023-10-06T04:19:26.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75e2ffd700 1 -- 172.21.15.37:0/3341936504 <== osd.4 v2:172.21.15.83:6800/90892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f75ec157860 con 0x7f75cc06d3a0 2023-10-06T04:19:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:26.469 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:26.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7f75cc06d3a0 msgr2=0x7f75cc06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6800/90892,v1:172.21.15.83:6801/90892] conn(0x7f75cc06d3a0 0x7f75cc06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75cc066f30 msgr2=0x7f75cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f75cc066f30 0x7f75cc0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0cd7e0 tx=0x7f75dc006f90 comp rx=0 tx=0).stop 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 msgr2=0x7f75ec155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 --2- 172.21.15.37:0/3341936504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec15ab20 0x7f75ec155a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009fd0 tx=0x7f75e4018000 comp rx=0 tx=0).stop 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75eb59e700 1 -- 172.21.15.37:0/3341936504 reap_dead start 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 shutdown_connections 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 >> 172.21.15.37:0/3341936504 conn(0x7f75ec099990 msgr2=0x7f75ec158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 shutdown_connections 2023-10-06T04:19:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.467+0000 7f75f1235700 1 -- 172.21.15.37:0/3341936504 wait complete. 2023-10-06T04:19:26.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:19:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.599+0000 7f081f1fe700 1 Processor -- start 2023-10-06T04:19:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.599+0000 7f081f1fe700 1 -- start start 2023-10-06T04:19:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081f1fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f08180ccb80 0x7f08180c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081f1fe700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08180c9730 con 0x7f0818157710 2023-10-06T04:19:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081f1fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081815e4a0 con 0x7f0818157340 2023-10-06T04:19:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081f1fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08180c8e00 con 0x7f08180ccb80 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081d79b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0818157710 0x7f081815d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42260/0 (socket says 172.21.15.37:42260) 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.600+0000 7f081d79b700 1 -- 172.21.15.37:0/3233049271 learned_addr learned my addr 172.21.15.37:0/3233049271 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f0817fff700 1 --2- 172.21.15.37:0/3233049271 >> v2:172.21.15.83:3300/0 conn(0x7f08180ccb80 0x7f08180c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702353961 0 0) 0x7f08180c9730 con 0x7f0818157710 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0804003570 con 0x7f0818157710 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949900427 0 0) 0x7f0804003570 con 0x7f0818157710 2023-10-06T04:19:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 >> v2:172.21.15.83:3300/0 conn(0x7f08180ccb80 msgr2=0x7f08180c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 --2- 172.21.15.37:0/3233049271 >> v2:172.21.15.83:3300/0 conn(0x7f08180ccb80 0x7f08180c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 >> v1:172.21.15.83:6789/0 conn(0x7f0818157340 legacy=0x7f08180cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180c90e0 con 0x7f0818157710 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f0800001470 con 0x7f0818157710 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 >> v1:172.21.15.37:6789/0 conn(0x7f0818157710 legacy=0x7f081815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0804003a60 0x7f0804003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0804004810 0x7f0804004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f080400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180c8e00 con 0x7f08040051c0 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080400c0e0 con 0x7f0804004810 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080400c2a0 con 0x7f0804003a60 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f081d79b700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f080400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f0817fff700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0804004810 0x7f0804004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.601+0000 7f081cf9a700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0804003a60 0x7f0804003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 -- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0804003a60 msgr2=0x7f0804003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0804003a60 0x7f0804003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 -- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0804004810 msgr2=0x7f0804004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0804004810 0x7f0804004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 -- 172.21.15.37:0/3233049271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804003570 con 0x7f08040051c0 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 -- 172.21.15.37:0/3233049271 reap_dead start 2023-10-06T04:19:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081d79b700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f080400ba60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f080000c3c0 tx=0x7f0800001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f001333000d15e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000cc90 con 0x7f08040051c0 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000ce30 con 0x7f08040051c0 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f08177fe700 1 -- 172.21.15.37:0/3233049271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800005b70 con 0x7f08040051c0 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081f1fe700 1 -- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 msgr2=0x7f080400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081f1fe700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f080400ba60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f080000c3c0 tx=0x7f0800001e70 comp rx=0 tx=0).stop 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081f1fe700 1 -- 172.21.15.37:0/3233049271 shutdown_connections 2023-10-06T04:19:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081f1fe700 1 --2- 172.21.15.37:0/3233049271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f080400ba60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.602+0000 7f081f1fe700 1 -- 172.21.15.37:0/3233049271 >> 172.21.15.37:0/3233049271 conn(0x7f081806baa0 msgr2=0x7f081806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.603+0000 7f081f1fe700 1 -- 172.21.15.37:0/3233049271 shutdown_connections 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.603+0000 7f081f1fe700 1 -- 172.21.15.37:0/3233049271 wait complete. 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.604+0000 7f081f1fe700 1 Processor -- start 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.604+0000 7f081f1fe700 1 -- start start 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.604+0000 7f081f1fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.604+0000 7f081f1fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 0x7f08180ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08180b4040 0x7f08180cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180c6850 con 0x7f08040051c0 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180c5c40 con 0x7f08180b3bd0 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08180c5f20 con 0x7f08180b4040 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56368/0 (socket says 172.21.15.37:56368) 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 -- 172.21.15.37:0/1187000894 learned_addr learned my addr 172.21.15.37:0/1187000894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f0817fff700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 0x7f08180ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081d79b700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08180b4040 0x7f08180cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 -- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08180b4040 msgr2=0x7f08180cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08180b4040 0x7f08180cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 -- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 msgr2=0x7f08180ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 0x7f08180ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 -- 172.21.15.37:0/1187000894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180c6200 con 0x7f08040051c0 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f0817fff700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 0x7f08180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081cf9a700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f081000ec70 tx=0x7f08100016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810001a10 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810001b90 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08180c64e0 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000c960 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.605+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08181538a0 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.606+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08180c6b30 con 0x7f08040051c0 2023-10-06T04:19:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.607+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0810002070 con 0x7f08040051c0 2023-10-06T04:19:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.607+0000 7f0814ff9700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.607+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0810084790 con 0x7f08040051c0 2023-10-06T04:19:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.607+0000 7f0817fff700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.608+0000 7f0817fff700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 0x7f07f80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08180b4550 tx=0x7f0808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.611+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0810051c20 con 0x7f08040051c0 2023-10-06T04:19:26.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.805+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f08180c6990 con 0x7f07f8066f30 2023-10-06T04:19:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.806+0000 7f0814ff9700 1 -- 172.21.15.37:0/1187000894 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f08080099c0 con 0x7f07f8066f30 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 msgr2=0x7f07f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 0x7f07f80693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08180b4550 tx=0x7f0808008040 comp rx=0 tx=0).stop 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 msgr2=0x7f0818152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f081000ec70 tx=0x7f08100016e0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 shutdown_connections 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08180b4040 0x7f08180cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08040051c0 0x7f0818152f30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 --2- 172.21.15.37:0/1187000894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08180b3bd0 0x7f08180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 >> 172.21.15.37:0/1187000894 conn(0x7f081806baa0 msgr2=0x7f08180cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 shutdown_connections 2023-10-06T04:19:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.808+0000 7f081f1fe700 1 -- 172.21.15.37:0/1187000894 wait complete. 2023-10-06T04:19:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:19:26.822 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:19:26.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.944+0000 7f37a0ff5700 1 Processor -- start 2023-10-06T04:19:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.944+0000 7f37a0ff5700 1 -- start start 2023-10-06T04:19:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f37a0ff5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b2650 0x7f379c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f37a0ff5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f379c0b0c50 0x7f379c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f37a0ff5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0ccad0 con 0x7f379c0b2a20 2023-10-06T04:19:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f37a0ff5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0d0f10 con 0x7f379c0b0c50 2023-10-06T04:19:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f37a0ff5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0cddd0 con 0x7f379c0b2650 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f379c0b0c50 0x7f379c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f379c0b0c50 0x7f379c0d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56374/0 (socket says 172.21.15.37:56374) 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 -- 172.21.15.37:0/3886934502 learned_addr learned my addr 172.21.15.37:0/3886934502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379b7fe700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b2650 0x7f379c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 -- 172.21.15.37:0/3886934502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b2650 msgr2=0x7f379c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b2650 0x7f379c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 -- 172.21.15.37:0/3886934502 >> v1:172.21.15.83:6789/0 conn(0x7f379c0b2a20 legacy=0x7f379c159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.945+0000 7f379affd700 1 -- 172.21.15.37:0/3886934502 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0ccdb0 con 0x7f379c0b0c50 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f379affd700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b0c50 0x7f379c0d03e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37900099b0 tx=0x7f3790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbc19480d51e843 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f379a7fc700 1 -- 172.21.15.37:0/3886934502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000b820 con 0x7f379c0b0c50 2023-10-06T04:19:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f379a7fc700 1 -- 172.21.15.37:0/3886934502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000b980 con 0x7f379c0b0c50 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f379a7fc700 1 -- 172.21.15.37:0/3886934502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000bd20 con 0x7f379c0b0c50 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3886934502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b0c50 msgr2=0x7f379c0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b0c50 0x7f379c0d03e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f37900099b0 tx=0x7f3790009250 comp rx=0 tx=0).stop 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3886934502 shutdown_connections 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b2650 0x7f379c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3886934502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b0c50 0x7f379c0d03e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3886934502 >> 172.21.15.37:0/3886934502 conn(0x7f379c06ed90 msgr2=0x7f379c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3886934502 shutdown_connections 2023-10-06T04:19:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.946+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3886934502 wait complete. 2023-10-06T04:19:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 Processor -- start 2023-10-06T04:19:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 -- start start 2023-10-06T04:19:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b0c50 0x7f379c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 0x7f379c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c0b2a20 0x7f379c0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0a7d00 con 0x7f379c0b2650 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0a70f0 con 0x7f379c0b2a20 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.948+0000 7f37a0ff5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0a73d0 con 0x7f379c0b0c50 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 0x7f379c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 0x7f379c0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56380/0 (socket says 172.21.15.37:56380) 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 -- 172.21.15.37:0/3580794044 learned_addr learned my addr 172.21.15.37:0/3580794044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379bfff700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c0b2a20 0x7f379c0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379b7fe700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b0c50 0x7f379c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 -- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b0c50 msgr2=0x7f379c1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f379c0b0c50 0x7f379c1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 -- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c0b2a20 msgr2=0x7f379c0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c0b2a20 0x7f379c0b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900094f0 con 0x7f379c0b2650 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379bfff700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f379c0b2a20 0x7f379c0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f379affd700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 0x7f379c0b4f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3790009290 tx=0x7f3790016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379001b470 con 0x7f379c0b2650 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379001b5d0 con 0x7f379c0b2650 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0a76b0 con 0x7f379c0b2650 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379001b970 con 0x7f379c0b2650 2023-10-06T04:19:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.949+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c0a8190 con 0x7f379c0b2650 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.950+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f379c0a8380 con 0x7f379c0b2650 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f379001c450 con 0x7f379c0b2650 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3788066f30 0x7f37880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3790085f70 con 0x7f379c0b2650 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f378806d3a0 0x7f378806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f378806fe80 con 0x7f378806d3a0 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f379b7fe700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3788066f30 0x7f37880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37900885b0 con 0x7f379c0b2650 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.951+0000 7f379bfff700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f378806d3a0 0x7f378806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.952+0000 7f379b7fe700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3788066f30 0x7f37880693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f378c006fd0 tx=0x7f378c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.952+0000 7f379bfff700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f378806d3a0 0x7f378806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.952+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== osd.5 v2:172.21.15.83:6808/90893 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f378806fe80 con 0x7f378806d3a0 2023-10-06T04:19:26.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.966+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 --> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f379c04c3c0 con 0x7f378806d3a0 2023-10-06T04:19:26.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37837fe700 1 -- 172.21.15.37:0/3580794044 <== osd.5 v2:172.21.15.83:6808/90893 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f379c04c3c0 con 0x7f378806d3a0 2023-10-06T04:19:26.968 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:26.968 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:26.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f378806d3a0 msgr2=0x7f378806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6808/90893,v1:172.21.15.83:6809/90893] conn(0x7f378806d3a0 0x7f378806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3788066f30 msgr2=0x7f37880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3788066f30 0x7f37880693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f378c006fd0 tx=0x7f378c008040 comp rx=0 tx=0).stop 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 msgr2=0x7f379c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 --2- 172.21.15.37:0/3580794044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379c0b2650 0x7f379c0b4f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3790009290 tx=0x7f3790016000 comp rx=0 tx=0).stop 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f379bfff700 1 -- 172.21.15.37:0/3580794044 reap_dead start 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 shutdown_connections 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 >> 172.21.15.37:0/3580794044 conn(0x7f379c06ed90 msgr2=0x7f379c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 shutdown_connections 2023-10-06T04:19:26.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:26.967+0000 7f37a0ff5700 1 -- 172.21.15.37:0/3580794044 wait complete. 2023-10-06T04:19:26.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:19:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.099+0000 7f90db1bb700 1 Processor -- start 2023-10-06T04:19:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.099+0000 7f90db1bb700 1 -- start start 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90db1bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90d40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90db1bb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40cf460 con 0x7f90d40b2810 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90db1bb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40ce890 con 0x7f90d40ccb90 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90db1bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40cfe30 con 0x7f90d40cb470 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90da1b9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90d40b2810 0x7f90d415db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42272/0 (socket says 172.21.15.37:42272) 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90da1b9700 1 -- 172.21.15.37:0/378891788 learned_addr learned my addr 172.21.15.37:0/378891788 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90d99b8700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90d40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361900534 0 0) 0x7f90d40cf460 con 0x7f90d40b2810 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.100+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90bc003570 con 0x7f90d40b2810 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384919229 0 0) 0x7f90bc003570 con 0x7f90d40b2810 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 msgr2=0x7f90d40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90d40cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 >> v1:172.21.15.83:6789/0 conn(0x7f90d40ccb90 legacy=0x7f90d40ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40ceb30 con 0x7f90d40b2810 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f90c40017f0 con 0x7f90d40b2810 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 >> v1:172.21.15.37:6789/0 conn(0x7f90d40b2810 legacy=0x7f90d415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc003a90 0x7f90bc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc004d50 0x7f90bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40cfe30 con 0x7f90bc003a90 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00bbf0 con 0x7f90bc004d50 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00bd80 con 0x7f90d40cb470 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc003a90 0x7f90bc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d99b8700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da9ba700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc004d50 0x7f90bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 -- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 msgr2=0x7f90bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40cb470 0x7f90bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 -- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc004d50 msgr2=0x7f90bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc004d50 0x7f90bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 -- 172.21.15.37:0/378891788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc003570 con 0x7f90bc003a90 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90da1b9700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc003a90 0x7f90bc003ea0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a860 tx=0x7f90c4002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7ae9d0ff2ff88b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40070f0 con 0x7f90bc003a90 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4007270 con 0x7f90bc003a90 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.101+0000 7f90d91b7700 1 -- 172.21.15.37:0/378891788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4007630 con 0x7f90bc003a90 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 -- 172.21.15.37:0/378891788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc003a90 msgr2=0x7f90bc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 --2- 172.21.15.37:0/378891788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc003a90 0x7f90bc003ea0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a860 tx=0x7f90c4002100 comp rx=0 tx=0).stop 2023-10-06T04:19:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90da9ba700 1 -- 172.21.15.37:0/378891788 reap_dead start 2023-10-06T04:19:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 -- 172.21.15.37:0/378891788 shutdown_connections 2023-10-06T04:19:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 -- 172.21.15.37:0/378891788 >> 172.21.15.37:0/378891788 conn(0x7f90d406ed90 msgr2=0x7f90d406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 -- 172.21.15.37:0/378891788 shutdown_connections 2023-10-06T04:19:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.102+0000 7f90db1bb700 1 -- 172.21.15.37:0/378891788 wait complete. 2023-10-06T04:19:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.103+0000 7f90db1bb700 1 Processor -- start 2023-10-06T04:19:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.103+0000 7f90db1bb700 1 -- start start 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc003a90 0x7f90d414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 0x7f90d40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c9f40 con 0x7f90d40c7f50 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d415c630 con 0x7f90bc003a90 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90db1bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40c8fd0 con 0x7f90d40c9590 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56404/0 (socket says 172.21.15.37:56404) 2023-10-06T04:19:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 -- 172.21.15.37:0/4279374427 learned_addr learned my addr 172.21.15.37:0/4279374427 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da1b9700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc003a90 0x7f90d414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90d99b8700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 0x7f90d40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 -- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 msgr2=0x7f90d40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 0x7f90d40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 -- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc003a90 msgr2=0x7f90d414d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc003a90 0x7f90d414d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 -- 172.21.15.37:0/4279374427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40c8cf0 con 0x7f90d40c7f50 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90d99b8700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 0x7f90d40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90da9ba700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cd740 tx=0x7f90cc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.104+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc011590 con 0x7f90d40c7f50 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.105+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc011710 con 0x7f90d40c7f50 2023-10-06T04:19:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.105+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d415bfe0 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.105+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc011ad0 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.105+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d414d720 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.105+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d415c7e0 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.106+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90cc01d460 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.106+0000 7f90d27fc700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.106+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f90cc084300 con 0x7f90d40c7f50 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.106+0000 7f90da1b9700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.107+0000 7f90da1b9700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a320 tx=0x7f90c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.111+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90d415c7e0 con 0x7f90d40c7f50 2023-10-06T04:19:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.305+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f90d415c7a0 con 0x7f90c0066f30 2023-10-06T04:19:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.305+0000 7f90d27fc700 1 -- 172.21.15.37:0/4279374427 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90d415c7a0 con 0x7f90c0066f30 2023-10-06T04:19:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 msgr2=0x7f90c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 0x7f90c00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a320 tx=0x7f90c4016000 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 msgr2=0x7f90d40c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f90d40cd740 tx=0x7f90cc007d30 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 shutdown_connections 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d40c7f50 0x7f90d40c83c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f90c0066f30 0x7f90c00693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90bc003a90 0x7f90d414d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 --2- 172.21.15.37:0/4279374427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f90d40c9590 0x7f90d40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 >> 172.21.15.37:0/4279374427 conn(0x7f90d406ed90 msgr2=0x7f90d40c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 shutdown_connections 2023-10-06T04:19:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.308+0000 7f90db1bb700 1 -- 172.21.15.37:0/4279374427 wait complete. 2023-10-06T04:19:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:19:27.321 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:19:27.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 Processor -- start 2023-10-06T04:19:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 -- start start 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3f0c15a0a0 0x7f3f0c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3f0c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0ce130 con 0x7f3f0c15ab20 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cb4c0 con 0x7f3f0c15a0a0 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.444+0000 7f3f12e7e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cd860 con 0x7f3f0c0cf5d0 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f10c1a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f0c15ab20 0x7f3f0c0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42288/0 (socket says 172.21.15.37:42288) 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f10c1a700 1 -- 172.21.15.37:0/2910145588 learned_addr learned my addr 172.21.15.37:0/2910145588 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3f0c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0bfff700 1 --2- 172.21.15.37:0/2910145588 >> v2:172.21.15.83:3300/0 conn(0x7f3f0c15a0a0 0x7f3f0c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625783019 0 0) 0x7f3f0c0ce130 con 0x7f3f0c15ab20 2023-10-06T04:19:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef4003570 con 0x7f3f0c15ab20 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819988218 0 0) 0x7f3ef4003570 con 0x7f3f0c15ab20 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 msgr2=0x7f3f0c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3f0c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 >> v2:172.21.15.83:3300/0 conn(0x7f3f0c15a0a0 msgr2=0x7f3f0c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 --2- 172.21.15.37:0/2910145588 >> v2:172.21.15.83:3300/0 conn(0x7f3f0c15a0a0 0x7f3f0c0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0cb6b0 con 0x7f3f0c15ab20 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7f3f040017f0 con 0x7f3f0c15ab20 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 >> v1:172.21.15.37:6789/0 conn(0x7f3f0c15ab20 legacy=0x7f3f0c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3ef4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cd860 con 0x7f3ef4004d50 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef400ba60 con 0x7f3ef4003fe0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef400bbd0 con 0x7f3f0c0cf5d0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.445+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f0bfff700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f10c1a700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3ef4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 -- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 msgr2=0x7f3ef4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0cf5d0 0x7f3ef4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 -- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ef4003fe0 msgr2=0x7f3ef4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ef4003fe0 0x7f3ef4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 -- 172.21.15.37:0/2910145588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4003570 con 0x7f3ef4004d50 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009c00 tx=0x7f3efc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4eda39127a158 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00e6b0 con 0x7f3ef4004d50 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00e810 con 0x7f3ef4004d50 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.446+0000 7f3f0b7fe700 1 -- 172.21.15.37:0/2910145588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00ebd0 con 0x7f3ef4004d50 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2910145588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4004d50 msgr2=0x7f3ef40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 --2- 172.21.15.37:0/2910145588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4004d50 0x7f3ef40051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009c00 tx=0x7f3efc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f1141b700 1 -- 172.21.15.37:0/2910145588 reap_dead start 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2910145588 shutdown_connections 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2910145588 >> 172.21.15.37:0/2910145588 conn(0x7f3f0c099990 msgr2=0x7f3f0c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2910145588 shutdown_connections 2023-10-06T04:19:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.447+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2910145588 wait complete. 2023-10-06T04:19:27.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.448+0000 7f3f12e7e700 1 Processor -- start 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.448+0000 7f3f12e7e700 1 -- start start 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f0c152b10 0x7f3f0c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0ca8c0 0x7f3f0c16cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 0x7f3f0c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c16d740 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cb440 con 0x7f3f0c152b10 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c155cf0 con 0x7f3f0c0ca8c0 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 0x7f3f0c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 0x7f3f0c156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56424/0 (socket says 172.21.15.37:56424) 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 -- 172.21.15.37:0/2837071985 learned_addr learned my addr 172.21.15.37:0/2837071985 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:27.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f0bfff700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0ca8c0 0x7f3f0c16cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f10c1a700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f0c152b10 0x7f3f0c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 -- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0ca8c0 msgr2=0x7f3f0c16cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f0c0ca8c0 0x7f3f0c16cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 -- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f0c152b10 msgr2=0x7f3f0c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f0c152b10 0x7f3f0c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0c5820 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f10c1a700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f0c152b10 0x7f3f0c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f1141b700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 0x7f3f0c156180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3efc016000 tx=0x7f3efc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc022070 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00eb90 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c152ee0 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.449+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00e6b0 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.450+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1556a0 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.450+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f0c04c3c0 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3efc01c890 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3ef8066f30 0x7f3ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3efc000e40 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f10c1a700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3ef8066f30 0x7f3ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7f3ef806d3a0 0x7f3ef806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ef806fe80 con 0x7f3ef806d3a0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.451+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3efc08a240 con 0x7f3f0c16d2c0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.452+0000 7f3f0bfff700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7f3ef806d3a0 0x7f3ef806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.452+0000 7f3f10c1a700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3ef8066f30 0x7f3ef80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f04001190 tx=0x7f3f04006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.452+0000 7f3f0bfff700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7f3ef806d3a0 0x7f3ef806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.453+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== osd.6 v2:172.21.15.83:6816/90923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3ef806fe80 con 0x7f3ef806d3a0 2023-10-06T04:19:27.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.466+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 --> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3f0c1541f0 con 0x7f3ef806d3a0 2023-10-06T04:19:27.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f08ff9700 1 -- 172.21.15.37:0/2837071985 <== osd.6 v2:172.21.15.83:6816/90923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3f0c1541f0 con 0x7f3ef806d3a0 2023-10-06T04:19:27.469 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:27.469 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:27.469 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7f3ef806d3a0 msgr2=0x7f3ef806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6816/90923,v1:172.21.15.83:6817/90923] conn(0x7f3ef806d3a0 0x7f3ef806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3ef8066f30 msgr2=0x7f3ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f3ef8066f30 0x7f3ef80693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f04001190 tx=0x7f3f04006040 comp rx=0 tx=0).stop 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 msgr2=0x7f3f0c156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 --2- 172.21.15.37:0/2837071985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0c16d2c0 0x7f3f0c156180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3efc016000 tx=0x7f3efc01a000 comp rx=0 tx=0).stop 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f1141b700 1 -- 172.21.15.37:0/2837071985 reap_dead start 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 shutdown_connections 2023-10-06T04:19:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.467+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 >> 172.21.15.37:0/2837071985 conn(0x7f3f0c099990 msgr2=0x7f3f0c1585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.468+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 shutdown_connections 2023-10-06T04:19:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.468+0000 7f3f12e7e700 1 -- 172.21.15.37:0/2837071985 wait complete. 2023-10-06T04:19:27.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:19:27.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.598+0000 7fc038ca9700 1 Processor -- start 2023-10-06T04:19:27.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.598+0000 7fc038ca9700 1 -- start start 2023-10-06T04:19:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.599+0000 7fc038ca9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0340b3430 0x7fc034159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.599+0000 7fc038ca9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc03415a260 0x7fc0340b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.599+0000 7fc038ca9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0340ab500 con 0x7fc034159950 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.599+0000 7fc038ca9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0340b6550 con 0x7fc03415a260 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.599+0000 7fc038ca9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340b1cc0 con 0x7fc0340b3430 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc03415a260 0x7fc0340b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc034159950 0x7fc0340b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42290/0 (socket says 172.21.15.37:42290) 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03259c700 1 -- 172.21.15.37:0/11367607 learned_addr learned my addr 172.21.15.37:0/11367607 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 --2- 172.21.15.37:0/11367607 >> v2:172.21.15.37:3300/0 conn(0x7fc03415a260 0x7fc0340b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56434/0 (socket says 172.21.15.37:56434) 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc031d9b700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0340b3430 0x7fc034159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 -- 172.21.15.37:0/11367607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0340b3430 msgr2=0x7fc034159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0340b3430 0x7fc034159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 -- 172.21.15.37:0/11367607 >> v1:172.21.15.37:6789/0 conn(0x7fc034159950 legacy=0x7fc0340b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03159a700 1 -- 172.21.15.37:0/11367607 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478281362 0 0) 0x7fc0340ab500 con 0x7fc034159950 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 -- 172.21.15.37:0/11367607 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340b10b0 con 0x7fc03415a260 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc032d9d700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc03415a260 0x7fc0340b4100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc024009e60 tx=0x7fc024009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7289ead3b0d97e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03159a700 1 -- 172.21.15.37:0/11367607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400e070 con 0x7fc03415a260 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03159a700 1 -- 172.21.15.37:0/11367607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02400bc30 con 0x7fc03415a260 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.600+0000 7fc03159a700 1 -- 172.21.15.37:0/11367607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024012430 con 0x7fc03415a260 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 -- 172.21.15.37:0/11367607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc03415a260 msgr2=0x7fc0340b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc03415a260 0x7fc0340b4100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc024009e60 tx=0x7fc024009780 comp rx=0 tx=0).stop 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 -- 172.21.15.37:0/11367607 shutdown_connections 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc03415a260 0x7fc0340b4100 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 --2- 172.21.15.37:0/11367607 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0340b3430 0x7fc034159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 -- 172.21.15.37:0/11367607 >> 172.21.15.37:0/11367607 conn(0x7fc034099a10 msgr2=0x7fc03406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 -- 172.21.15.37:0/11367607 shutdown_connections 2023-10-06T04:19:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.601+0000 7fc038ca9700 1 -- 172.21.15.37:0/11367607 wait complete. 2023-10-06T04:19:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.602+0000 7fc038ca9700 1 Processor -- start 2023-10-06T04:19:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.602+0000 7fc038ca9700 1 -- start start 2023-10-06T04:19:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0340b3430 0x7fc0341549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03415a260 0x7fc034068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03415bc90 con 0x7fc034159950 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034154fc0 con 0x7fc0340b3430 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341552a0 con 0x7fc03415a260 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56438/0 (socket says 172.21.15.37:56438) 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 -- 172.21.15.37:0/4109298123 learned_addr learned my addr 172.21.15.37:0/4109298123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 -- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03415a260 msgr2=0x7fc034068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03415a260 0x7fc034068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 -- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0340b3430 msgr2=0x7fc0341549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0340b3430 0x7fc0341549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 -- 172.21.15.37:0/4109298123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009a20 con 0x7fc034159950 2023-10-06T04:19:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc031d9b700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d890 tx=0x7fc01c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00b600 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c00b760 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00bae0 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.603+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc034155580 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.604+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0340cf860 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.604+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03415ba60 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.605+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc01c01e460 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.605+0000 7fc02a7fc700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.605+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc01c084a40 con 0x7fc034159950 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.605+0000 7fc03259c700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.606+0000 7fc03259c700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0011e0 tx=0x7fc02c0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.609+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03415ba60 con 0x7fc034159950 2023-10-06T04:19:27.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.800+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc03415ba60 con 0x7fc014066f30 2023-10-06T04:19:27.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.801+0000 7fc02a7fc700 1 -- 172.21.15.37:0/4109298123 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc03415ba60 con 0x7fc014066f30 2023-10-06T04:19:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 msgr2=0x7fc0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 0x7fc0140693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0011e0 tx=0x7fc02c0079d0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 msgr2=0x7fc034152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d890 tx=0x7fc01c008040 comp rx=0 tx=0).stop 2023-10-06T04:19:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 shutdown_connections 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc03415a260 0x7fc034068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fc014066f30 0x7fc0140693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0340b3430 0x7fc0341549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 --2- 172.21.15.37:0/4109298123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc034159950 0x7fc034152ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 >> 172.21.15.37:0/4109298123 conn(0x7fc034099a10 msgr2=0x7fc03406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 shutdown_connections 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.802+0000 7fc038ca9700 1 -- 172.21.15.37:0/4109298123 wait complete. 2023-10-06T04:19:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:19:27.816 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:19:27.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:19:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.940+0000 7f192b449700 1 Processor -- start 2023-10-06T04:19:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.940+0000 7f192b449700 1 -- start start 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f192415ab60 0x7f19240cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f192415a0e0 0x7f19240ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19240cd320 0x7f19240ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240ce130 con 0x7f192415a0e0 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240cb6b0 con 0x7f192415ab60 2023-10-06T04:19:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f192b449700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240cb990 con 0x7f19240cd320 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f192415a0e0 0x7f19240ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f192415a0e0 0x7f19240ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56452/0 (socket says 172.21.15.37:56452) 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 -- 172.21.15.37:0/2403351300 learned_addr learned my addr 172.21.15.37:0/2403351300 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19299e6700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19240cd320 0x7f19240ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19291e5700 1 --2- 172.21.15.37:0/2403351300 >> v2:172.21.15.83:3300/0 conn(0x7f192415ab60 0x7f19240cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 -- 172.21.15.37:0/2403351300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19240cd320 msgr2=0x7f19240ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19240cd320 0x7f19240ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 -- 172.21.15.37:0/2403351300 >> v2:172.21.15.83:3300/0 conn(0x7f192415ab60 msgr2=0x7f19240cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.941+0000 7f19289e4700 1 --2- 172.21.15.37:0/2403351300 >> v2:172.21.15.83:3300/0 conn(0x7f192415ab60 0x7f19240cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f19289e4700 1 -- 172.21.15.37:0/2403351300 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240cbc70 con 0x7f192415a0e0 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f19289e4700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192415a0e0 0x7f19240ccde0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1924088910 tx=0x7f1918009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accec6afc373fbad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f1923fff700 1 -- 172.21.15.37:0/2403351300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800b640 con 0x7f192415a0e0 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f1923fff700 1 -- 172.21.15.37:0/2403351300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191800b7a0 con 0x7f192415a0e0 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f1923fff700 1 -- 172.21.15.37:0/2403351300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800bb60 con 0x7f192415a0e0 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 -- 172.21.15.37:0/2403351300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192415a0e0 msgr2=0x7f19240ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192415a0e0 0x7f19240ccde0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1924088910 tx=0x7f1918009250 comp rx=0 tx=0).stop 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 -- 172.21.15.37:0/2403351300 shutdown_connections 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f19240cd320 0x7f19240ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 --2- 172.21.15.37:0/2403351300 >> v2:172.21.15.83:3300/0 conn(0x7f192415ab60 0x7f19240cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 --2- 172.21.15.37:0/2403351300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192415a0e0 0x7f19240ccde0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.942+0000 7f192b449700 1 -- 172.21.15.37:0/2403351300 >> 172.21.15.37:0/2403351300 conn(0x7f1924099990 msgr2=0x7f192406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.943+0000 7f192b449700 1 -- 172.21.15.37:0/2403351300 shutdown_connections 2023-10-06T04:19:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.943+0000 7f192b449700 1 -- 172.21.15.37:0/2403351300 wait complete. 2023-10-06T04:19:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 Processor -- start 2023-10-06T04:19:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 -- start start 2023-10-06T04:19:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 0x7f1924153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f192415a0e0 0x7f19241696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f192415ab60 0x7f19240ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240c5eb0 con 0x7f19240cd320 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.944+0000 7f192b449700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240caac0 con 0x7f192415ab60 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f192b449700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240c5860 con 0x7f192415a0e0 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 0x7f1924153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 0x7f1924153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56454/0 (socket says 172.21.15.37:56454) 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 -- 172.21.15.37:0/1778758006 learned_addr learned my addr 172.21.15.37:0/1778758006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19289e4700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f192415a0e0 0x7f19241696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19299e6700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f192415ab60 0x7f19240ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 -- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f192415a0e0 msgr2=0x7f19241696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f192415a0e0 0x7f19241696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 -- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f192415ab60 msgr2=0x7f19240ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f192415ab60 0x7f19240ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180094f0 con 0x7f19240cd320 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19299e6700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f192415ab60 0x7f19240ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19291e5700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 0x7f1924153c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1914009f40 tx=0x7f191400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400cc20 con 0x7f19240cd320 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400f040 con 0x7f19240cd320 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240c5b40 con 0x7f19240cd320 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914014480 con 0x7f19240cd320 2023-10-06T04:19:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.945+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1924169c20 con 0x7f19240cd320 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.946+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19240c56c0 con 0x7f19240cd320 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19140147f0 con 0x7f19240cd320 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1910066f30 0x7f19100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1914084b80 con 0x7f19240cd320 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19289e4700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1910066f30 0x7f19100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f191006d3a0 0x7f191006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f191006fe80 con 0x7f191006d3a0 2023-10-06T04:19:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19140891e0 con 0x7f19240cd320 2023-10-06T04:19:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.947+0000 7f19299e6700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f191006d3a0 0x7f191006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.948+0000 7f19289e4700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1910066f30 0x7f19100693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1924088910 tx=0x7f1918017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.948+0000 7f19299e6700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f191006d3a0 0x7f191006f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.949+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== osd.7 v2:172.21.15.83:6820/90922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f191006fe80 con 0x7f191006d3a0 2023-10-06T04:19:27.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.962+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 --> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1924169e10 con 0x7f191006d3a0 2023-10-06T04:19:27.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f19217fa700 1 -- 172.21.15.37:0/1778758006 <== osd.7 v2:172.21.15.83:6820/90922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1924169e10 con 0x7f191006d3a0 2023-10-06T04:19:27.964 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T04:19:27.965 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:19:27.965 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f191006d3a0 msgr2=0x7f191006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6820/90922,v1:172.21.15.83:6822/90922] conn(0x7f191006d3a0 0x7f191006f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1910066f30 msgr2=0x7f19100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f1910066f30 0x7f19100693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1924088910 tx=0x7f1918017000 comp rx=0 tx=0).stop 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 msgr2=0x7f1924153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 --2- 172.21.15.37:0/1778758006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19240cd320 0x7f1924153c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1914009f40 tx=0x7f191400b040 comp rx=0 tx=0).stop 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f19299e6700 1 -- 172.21.15.37:0/1778758006 reap_dead start 2023-10-06T04:19:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 shutdown_connections 2023-10-06T04:19:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.963+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 >> 172.21.15.37:0/1778758006 conn(0x7f1924099990 msgr2=0x7f192415bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.964+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 shutdown_connections 2023-10-06T04:19:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:27.964+0000 7f192b449700 1 -- 172.21.15.37:0/1778758006 wait complete. 2023-10-06T04:19:27.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:19:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.095+0000 7ff6755db700 1 Processor -- start 2023-10-06T04:19:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.095+0000 7ff6755db700 1 -- start start 2023-10-06T04:19:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.095+0000 7ff6755db700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6700b3430 0x7ff670159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.095+0000 7ff6755db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff67015a260 0x7ff6700b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.095+0000 7ff6755db700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6700ab500 con 0x7ff670159950 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff6755db700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6700b6550 con 0x7ff6700b3430 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff6755db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6700b1cc0 con 0x7ff67015a260 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff670159950 0x7ff6700b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42306/0 (socket says 172.21.15.37:42306) 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6700b3430 0x7ff670159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66effd700 1 -- 172.21.15.37:0/447922959 learned_addr learned my addr 172.21.15.37:0/447922959 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66f7fe700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff67015a260 0x7ff6700b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66dffb700 1 -- 172.21.15.37:0/447922959 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611093904 0 0) 0x7ff6700ab500 con 0x7ff670159950 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66dffb700 1 -- 172.21.15.37:0/447922959 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff65c003570 con 0x7ff670159950 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 -- 172.21.15.37:0/447922959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff67015a260 msgr2=0x7ff6700b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff67015a260 0x7ff6700b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 -- 172.21.15.37:0/447922959 >> v1:172.21.15.37:6789/0 conn(0x7ff670159950 legacy=0x7ff6700b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 -- 172.21.15.37:0/447922959 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6700b10b0 con 0x7ff6700b3430 2023-10-06T04:19:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66e7fc700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6700b3430 0x7ff670159d20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098e0 tx=0x7ff6580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a2a5847bb90ad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66dffb700 1 -- 172.21.15.37:0/447922959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011630 con 0x7ff6700b3430 2023-10-06T04:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66dffb700 1 -- 172.21.15.37:0/447922959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658011790 con 0x7ff6700b3430 2023-10-06T04:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.096+0000 7ff66dffb700 1 -- 172.21.15.37:0/447922959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011b30 con 0x7ff6700b3430 2023-10-06T04:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 -- 172.21.15.37:0/447922959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6700b3430 msgr2=0x7ff670159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6700b3430 0x7ff670159d20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6580098e0 tx=0x7ff6580091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 -- 172.21.15.37:0/447922959 shutdown_connections 2023-10-06T04:19:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff67015a260 0x7ff6700b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 --2- 172.21.15.37:0/447922959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6700b3430 0x7ff670159d20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 -- 172.21.15.37:0/447922959 >> 172.21.15.37:0/447922959 conn(0x7ff670099a10 msgr2=0x7ff67006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 -- 172.21.15.37:0/447922959 shutdown_connections 2023-10-06T04:19:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.097+0000 7ff6755db700 1 -- 172.21.15.37:0/447922959 wait complete. 2023-10-06T04:19:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.098+0000 7ff6755db700 1 Processor -- start 2023-10-06T04:19:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.098+0000 7ff6755db700 1 -- start start 2023-10-06T04:19:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6700b3430 0x7ff6700ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff670159950 0x7ff67016b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6700ad6f0 con 0x7ff67015a260 2023-10-06T04:19:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6700ac1f0 con 0x7ff670159950 2023-10-06T04:19:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff6755db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6700adf70 con 0x7ff6700b3430 2023-10-06T04:19:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56482/0 (socket says 172.21.15.37:56482) 2023-10-06T04:19:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 -- 172.21.15.37:0/2572029226 learned_addr learned my addr 172.21.15.37:0/2572029226 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66effd700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6700b3430 0x7ff6700ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66e7fc700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff670159950 0x7ff67016b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 -- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6700b3430 msgr2=0x7ff6700ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6700b3430 0x7ff6700ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 -- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff670159950 msgr2=0x7ff67016b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff670159950 0x7ff67016b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 -- 172.21.15.37:0/2572029226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658009420 con 0x7ff67015a260 2023-10-06T04:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.099+0000 7ff66f7fe700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e8d0 tx=0x7ff6680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.100+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800ee70 con 0x7ff67015a260 2023-10-06T04:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.100+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66800c850 con 0x7ff67015a260 2023-10-06T04:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.100+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6700abf10 con 0x7ff67015a260 2023-10-06T04:19:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.100+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800cc50 con 0x7ff67015a260 2023-10-06T04:19:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.100+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6700adc00 con 0x7ff67015a260 2023-10-06T04:19:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.101+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6700ae0e0 con 0x7ff67015a260 2023-10-06T04:19:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.101+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff668013680 con 0x7ff67015a260 2023-10-06T04:19:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.101+0000 7ff666ffd700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 0x7ff6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.102+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff668084550 con 0x7ff67015a260 2023-10-06T04:19:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.102+0000 7ff66effd700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 0x7ff6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.102+0000 7ff66effd700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 0x7ff6500693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff660005c50 tx=0x7ff660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.106+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff668051960 con 0x7ff67015a260 2023-10-06T04:19:28.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.298+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff670063410 con 0x7ff650066f30 2023-10-06T04:19:28.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.299+0000 7ff666ffd700 1 -- 172.21.15.37:0/2572029226 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff670063410 con 0x7ff650066f30 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 msgr2=0x7ff6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 0x7ff6500693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff660005c50 tx=0x7ff660009040 comp rx=0 tx=0).stop 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 msgr2=0x7ff6700afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e8d0 tx=0x7ff6680091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 shutdown_connections 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67015a260 0x7ff6700afec0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6700b3430 0x7ff6700ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7ff650066f30 0x7ff6500693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 --2- 172.21.15.37:0/2572029226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff670159950 0x7ff67016b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 >> 172.21.15.37:0/2572029226 conn(0x7ff670099a10 msgr2=0x7ff670157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 shutdown_connections 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.301+0000 7ff6755db700 1 -- 172.21.15.37:0/2572029226 wait complete. 2023-10-06T04:19:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:19:28.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:19:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.432+0000 7f676f528700 1 Processor -- start 2023-10-06T04:19:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 -- start start 2023-10-06T04:19:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6768159950 0x7f67680b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67680b3430 0x7f6768159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f67680b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67680b6550 con 0x7f67680b3430 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67680ab500 con 0x7f6768159950 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.433+0000 7f676f528700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67680b1cc0 con 0x7f676815a260 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67680b3430 0x7f6768159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67680b3430 0x7f6768159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56484/0 (socket says 172.21.15.37:56484) 2023-10-06T04:19:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 -- 172.21.15.37:0/3610818198 learned_addr learned my addr 172.21.15.37:0/3610818198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676d2c4700 1 --2- 172.21.15.37:0/3610818198 >> v2:172.21.15.83:3300/0 conn(0x7f6768159950 0x7f67680b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676dac5700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f67680b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 -- 172.21.15.37:0/3610818198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 msgr2=0x7f67680b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f67680b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 -- 172.21.15.37:0/3610818198 >> v2:172.21.15.83:3300/0 conn(0x7f6768159950 msgr2=0x7f67680b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 --2- 172.21.15.37:0/3610818198 >> v2:172.21.15.83:3300/0 conn(0x7f6768159950 0x7f67680b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 -- 172.21.15.37:0/3610818198 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680b0e30 con 0x7f67680b3430 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f676cac3700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768159d20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f67680895c0 tx=0x7f675c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c8c51572e3a3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f6767fff700 1 -- 172.21.15.37:0/3610818198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00b860 con 0x7f67680b3430 2023-10-06T04:19:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f6767fff700 1 -- 172.21.15.37:0/3610818198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00b9c0 con 0x7f67680b3430 2023-10-06T04:19:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.434+0000 7f6767fff700 1 -- 172.21.15.37:0/3610818198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00bd60 con 0x7f67680b3430 2023-10-06T04:19:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 -- 172.21.15.37:0/3610818198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 msgr2=0x7f6768159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768159d20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f67680895c0 tx=0x7f675c009250 comp rx=0 tx=0).stop 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 -- 172.21.15.37:0/3610818198 shutdown_connections 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f67680b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 --2- 172.21.15.37:0/3610818198 >> v2:172.21.15.83:3300/0 conn(0x7f6768159950 0x7f67680b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 --2- 172.21.15.37:0/3610818198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768159d20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 -- 172.21.15.37:0/3610818198 >> 172.21.15.37:0/3610818198 conn(0x7f6768099a10 msgr2=0x7f676806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 -- 172.21.15.37:0/3610818198 shutdown_connections 2023-10-06T04:19:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.435+0000 7f676f528700 1 -- 172.21.15.37:0/3610818198 wait complete. 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.436+0000 7f676f528700 1 Processor -- start 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.436+0000 7f676f528700 1 -- start start 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768159950 0x7f6768169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f676815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6768158c60 con 0x7f67680b3430 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67680ab640 con 0x7f6768159950 2023-10-06T04:19:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676f528700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6768159160 con 0x7f676815a260 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56496/0 (socket says 172.21.15.37:56496) 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 -- 172.21.15.37:0/3957032198 learned_addr learned my addr 172.21.15.37:0/3957032198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676dac5700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f676815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676cac3700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768159950 0x7f6768169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 -- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 msgr2=0x7f676815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f676815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 -- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768159950 msgr2=0x7f6768169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768159950 0x7f6768169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.437+0000 7f676d2c4700 1 -- 172.21.15.37:0/3957032198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0094f0 con 0x7f67680b3430 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f676d2c4700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f676000d8c0 tx=0x7f6760008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000de60 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676000b780 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67680ac460 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000bb20 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.438+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67680abbb0 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.439+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67680ac740 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.439+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f676001e460 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.440+0000 7f67657fa700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 0x7f67540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.440+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6760084ac0 con 0x7f67680b3430 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.440+0000 7f676cac3700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 0x7f67540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.440+0000 7f676cac3700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 0x7f67540693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67680895c0 tx=0x7f675c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.444+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6760051e30 con 0x7f67680b3430 2023-10-06T04:19:28.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.636+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6768063410 con 0x7f6754066f30 2023-10-06T04:19:28.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.639+0000 7f67657fa700 1 -- 172.21.15.37:0/3957032198 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73557 (secure 0 0 0) 0x7f6768063410 con 0x7f6754066f30 2023-10-06T04:19:28.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:28.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.641+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 msgr2=0x7f67540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.641+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 0x7f67540693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67680895c0 tx=0x7f675c017000 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.641+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 msgr2=0x7f6768158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.641+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f676000d8c0 tx=0x7f6760008040 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 shutdown_connections 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f676815a260 0x7f676815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67680b3430 0x7f6768158720 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6754066f30 0x7f67540693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 --2- 172.21.15.37:0/3957032198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768159950 0x7f6768169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 >> 172.21.15.37:0/3957032198 conn(0x7f6768099a10 msgr2=0x7f67680b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 shutdown_connections 2023-10-06T04:19:28.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:28.642+0000 7f676f528700 1 -- 172.21.15.37:0/3957032198 wait complete. 2023-10-06T04:19:28.645 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:19:28.655 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-10-06T04:19:27.520535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2383016,"kb_used_data":4712,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591704,"statfs":{"total":773094113280,"available":770653904896,"internally_reserved":0,"allocated":4825088,"data_stored":2682960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.687529"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:20.028874+0000","last_change":"2023-10-06T04:16:50.906163+0000","last_active":"2023-10-06T04:19:20.028874+0000","last_peered":"2023-10-06T04:19:20.028874+0000","last_clean":"2023-10-06T04:19:20.028874+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:19:20.028874+0000","last_undegraded":"2023-10-06T04:19:20.028874+0000","last_fullsized":"2023-10-06T04:19:20.028874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.836603+0000","last_change":"2023-10-06T04:16:50.616515+0000","last_active":"2023-10-06T04:19:18.836603+0000","last_peered":"2023-10-06T04:19:18.836603+0000","last_clean":"2023-10-06T04:19:18.836603+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:19:18.836603+0000","last_undegraded":"2023-10-06T04:19:18.836603+0000","last_fullsized":"2023-10-06T04:19:18.836603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:20.023664+0000","last_change":"2023-10-06T04:16:50.842110+0000","last_active":"2023-10-06T04:19:20.023664+0000","last_peered":"2023-10-06T04:19:20.023664+0000","last_clean":"2023-10-06T04:19:20.023664+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:19:20.023664+0000","last_undegraded":"2023-10-06T04:19:20.023664+0000","last_fullsized":"2023-10-06T04:19:20.023664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835724+0000","last_change":"2023-10-06T04:16:50.616765+0000","last_active":"2023-10-06T04:19:18.835724+0000","last_peered":"2023-10-06T04:19:18.835724+0000","last_clean":"2023-10-06T04:19:18.835724+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:19:18.835724+0000","last_undegraded":"2023-10-06T04:19:18.835724+0000","last_fullsized":"2023-10-06T04:19:18.835724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:50.892597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834950+0000","last_change":"2023-10-06T04:16:43.530856+0000","last_active":"2023-10-06T04:19:18.834950+0000","last_peered":"2023-10-06T04:19:18.834950+0000","last_clean":"2023-10-06T04:19:18.834950+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:19:18.834950+0000","last_undegraded":"2023-10-06T04:19:18.834950+0000","last_fullsized":"2023-10-06T04:19:18.834950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:42.483989+0000","last_clean_scrub_stamp":"2023-10-06T04:16:42.483989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:38.935653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.834914+0000","last_change":"2023-10-06T04:16:50.617270+0000","last_active":"2023-10-06T04:19:18.834914+0000","last_peered":"2023-10-06T04:19:18.834914+0000","last_clean":"2023-10-06T04:19:18.834914+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:19:18.834914+0000","last_undegraded":"2023-10-06T04:19:18.834914+0000","last_fullsized":"2023-10-06T04:19:18.834914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:17.347095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.835926+0000","last_change":"2023-10-06T04:16:50.903867+0000","last_active":"2023-10-06T04:19:18.835926+0000","last_peered":"2023-10-06T04:19:18.835926+0000","last_clean":"2023-10-06T04:19:18.835926+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:19:18.835926+0000","last_undegraded":"2023-10-06T04:19:18.835926+0000","last_fullsized":"2023-10-06T04:19:18.835926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:13.770889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:20.027738+0000","last_change":"2023-10-06T04:16:50.616724+0000","last_active":"2023-10-06T04:19:20.027738+0000","last_peered":"2023-10-06T04:19:20.027738+0000","last_clean":"2023-10-06T04:19:20.027738+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:19:20.027738+0000","last_undegraded":"2023-10-06T04:19:20.027738+0000","last_fullsized":"2023-10-06T04:19:20.027738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:19:18.954523+0000","last_change":"2023-10-06T04:16:50.618522+0000","last_active":"2023-10-06T04:19:18.954523+0000","last_peered":"2023-10-06T04:19:18.954523+0000","last_clean":"2023-10-06T04:19:18.954523+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:19:18.954523+0000","last_undegraded":"2023-10-06T04:19:18.954523+0000","last_fullsized":"2023-10-06T04:19:18.954523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:16:49.592313+0000","last_clean_scrub_stamp":"2023-10-06T04:16:49.592313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:32.680984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.0329999999999999,"15min":1.129},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.57199999999999995,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.56200000000000006,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.95899999999999996,"15min":1.03},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.59699999999999998,"5min":11.288,"15min":11.288},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.90900000000000003,"15min":0.97999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61499999999999999,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.90800000000000003,"15min":0.98399999999999999},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52800000000000002,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.98299999999999998,"15min":1.0580000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65600000000000003,"5min":11.33,"15min":11.33},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.60199999999999998,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.67700000000000005,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.745,"15min":0.745},"last":0.74199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.624,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68400000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.747},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.63600000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70199999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.47099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.24199999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40699999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.50800000000000001,"5min":0.752,"15min":0.752},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49099999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":1.002,"15min":1.002},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76700000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63800000000000001,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71899999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80100000000000005,"5min":1.046,"15min":1.046},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76100000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.78100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.38400000000000001,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.253,"5min":0.247,"15min":0.247},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.38400000000000001,"15min":0.39200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.42399999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.63100000000000001,"15min":0.58499999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.7000000000000002,"5min":5.7000000000000002,"15min":5.7000000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.63500000000000001,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":5.7460000000000004,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":5.7320000000000002,"5min":5.7320000000000002,"15min":5.7320000000000002},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.23200000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.42299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34599999999999997,"15min":0.35099999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.28199999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47799999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.45800000000000002,"5min":0.629,"15min":0.629},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.626},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33400000000000002,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.31900000000000001},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.48099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.49199999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81000000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":1.141,"15min":1.141},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57899999999999996,"5min":0.746,"15min":0.746},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.58799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79900000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.747,"15min":0.747},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.438},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.61299999999999999,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.6690000000000005,"5min":8.6690000000000005,"15min":8.6690000000000005},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.64800000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.749,"15min":0.749},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.626},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:19:28.660 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.660 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.660 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.661 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.661 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:16:42.483989+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.661 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.662 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.662 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.662 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T04:16:49.592313+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=16, tm_sec=49, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=19, tm_sec=23, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:19:28.662 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:19:48.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:19:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.795+0000 7f6aa2125700 1 Processor -- start 2023-10-06T04:19:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.795+0000 7f6aa2125700 1 -- start start 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa2125700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 0x7f6a9c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa2125700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0cf460 con 0x7f6a9c0cb470 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa2125700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0ce890 con 0x7f6a9c0ccb90 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa2125700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cfe30 con 0x7f6a9c0b2810 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa0922700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a9c0cb470 0x7f6a9c15db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36720/0 (socket says 172.21.15.37:36720) 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.796+0000 7f6aa0922700 1 -- 172.21.15.37:0/3825846910 learned_addr learned my addr 172.21.15.37:0/3825846910 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6aa1123700 1 --2- 172.21.15.37:0/3825846910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 0x7f6a9c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902029183 0 0) 0x7f6a9c0cf460 con 0x7f6a9c0cb470 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a84003570 con 0x7f6a9c0cb470 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912669634 0 0) 0x7f6a9c0ce890 con 0x7f6a9c0ccb90 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0cf460 con 0x7f6a9c0ccb90 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6aa1123700 1 -- 172.21.15.37:0/3825846910 >> v1:172.21.15.83:6789/0 conn(0x7f6a9c0ccb90 legacy=0x7f6a9c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567086095 0 0) 0x7f6a84003570 con 0x7f6a9c0cb470 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6aa1123700 1 -- 172.21.15.37:0/3825846910 >> v1:172.21.15.37:6789/0 conn(0x7f6a9c0cb470 legacy=0x7f6a9c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6aa1123700 1 -- 172.21.15.37:0/3825846910 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0ceb30 con 0x7f6a9c0b2810 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6aa1123700 1 --2- 172.21.15.37:0/3825846910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 0x7f6a9c0cf8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009e90 tx=0x7f6a8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2468d8342cf1c3ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00e070 con 0x7f6a9c0b2810 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00b870 con 0x7f6a9c0b2810 2023-10-06T04:19:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.797+0000 7f6a9bfff700 1 -- 172.21.15.37:0/3825846910 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90001470 con 0x7f6a9c0b2810 2023-10-06T04:19:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 -- 172.21.15.37:0/3825846910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 msgr2=0x7f6a9c0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 --2- 172.21.15.37:0/3825846910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 0x7f6a9c0cf8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009e90 tx=0x7f6a8c009780 comp rx=0 tx=0).stop 2023-10-06T04:19:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 -- 172.21.15.37:0/3825846910 shutdown_connections 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 --2- 172.21.15.37:0/3825846910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0b2810 0x7f6a9c0cf8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 -- 172.21.15.37:0/3825846910 >> 172.21.15.37:0/3825846910 conn(0x7f6a9c06ed90 msgr2=0x7f6a9c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 -- 172.21.15.37:0/3825846910 shutdown_connections 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.798+0000 7f6aa2125700 1 -- 172.21.15.37:0/3825846910 wait complete. 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.799+0000 7f6aa2125700 1 Processor -- start 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.799+0000 7f6aa2125700 1 -- start start 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a9c0b2810 0x7f6a9c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 0x7f6a9c169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c9f80 con 0x7f6a9c0cb470 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c7a30 con 0x7f6a9c0b2810 2023-10-06T04:19:48.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa2125700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c16d9b0 con 0x7f6a9c0ccb90 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53802/0 (socket says 172.21.15.37:53802) 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 -- 172.21.15.37:0/1215025548 learned_addr learned my addr 172.21.15.37:0/1215025548 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa1123700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a9c0b2810 0x7f6a9c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa1924700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 0x7f6a9c169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 -- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 msgr2=0x7f6a9c169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 0x7f6a9c169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 -- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a9c0b2810 msgr2=0x7f6a9c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a9c0b2810 0x7f6a9c156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.800+0000 7f6aa0922700 1 -- 172.21.15.37:0/1215025548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c009a20 con 0x7f6a9c0cb470 2023-10-06T04:19:48.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6aa1924700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 0x7f6a9c169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6aa0922700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000cb70 tx=0x7f6a90001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90005920 con 0x7f6a9c0cb470 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90005a80 con 0x7f6a9c0cb470 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c16dc90 con 0x7f6a9c0cb470 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90005e20 con 0x7f6a9c0cb470 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.801+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0b4dd0 con 0x7f6a9c0cb470 2023-10-06T04:19:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.802+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c16deb0 con 0x7f6a9c0cb470 2023-10-06T04:19:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.802+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a90007510 con 0x7f6a9c0cb470 2023-10-06T04:19:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.803+0000 7f6a997fa700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 0x7f6a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.803+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6a90084350 con 0x7f6a9c0cb470 2023-10-06T04:19:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.803+0000 7f6aa1123700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 0x7f6a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:48.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.804+0000 7f6aa1123700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 0x7f6a880693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0097c0 tx=0x7f6a8c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:48.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.807+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a900517e0 con 0x7f6a9c0cb470 2023-10-06T04:19:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.995+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 --> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a9c0c7500 con 0x7f6a88066f30 2023-10-06T04:19:49.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:48.999+0000 7f6a997fa700 1 -- 172.21.15.37:0/1215025548 <== mgr.4100 v2:172.21.15.83:6832/90301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73598 (secure 0 0 0) 0x7f6a9c0c7500 con 0x7f6a88066f30 2023-10-06T04:19:49.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 msgr2=0x7f6a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 0x7f6a880693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0097c0 tx=0x7f6a8c017000 comp rx=0 tx=0).stop 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 msgr2=0x7f6a9c16cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000cb70 tx=0x7f6a90001a50 comp rx=0 tx=0).stop 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 shutdown_connections 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a9c0ccb90 0x7f6a9c169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7f6a88066f30 0x7f6a880693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a9c0b2810 0x7f6a9c156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 --2- 172.21.15.37:0/1215025548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a9c0cb470 0x7f6a9c16cfd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 >> 172.21.15.37:0/1215025548 conn(0x7f6a9c06ed90 msgr2=0x7f6a9c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 shutdown_connections 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.000+0000 7f6aa2125700 1 -- 172.21.15.37:0/1215025548 wait complete. 2023-10-06T04:19:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T04:19:49.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-06T04:19:47.524658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2383016,"kb_used_data":4712,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591704,"statfs":{"total":773094113280,"available":770653904896,"internally_reserved":0,"allocated":4825088,"data_stored":2682960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002270"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:30.344507+0000","last_change":"2023-10-06T04:19:30.344481+0000","last_active":"2023-10-06T04:19:30.344507+0000","last_peered":"2023-10-06T04:19:30.344507+0000","last_clean":"2023-10-06T04:19:30.344507+0000","last_became_active":"2023-10-06T04:16:50.905875+0000","last_became_peered":"2023-10-06T04:16:50.905875+0000","last_unstale":"2023-10-06T04:19:30.344507+0000","last_undegraded":"2023-10-06T04:19:30.344507+0000","last_fullsized":"2023-10-06T04:19:30.344507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:30.344376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:30.344376+0000","last_clean_scrub_stamp":"2023-10-06T04:19:30.344376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:41.245748+0000","scrub_duration":0.0015234619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:29.808446+0000","last_change":"2023-10-06T04:19:29.808409+0000","last_active":"2023-10-06T04:19:29.808446+0000","last_peered":"2023-10-06T04:19:29.808446+0000","last_clean":"2023-10-06T04:19:29.808446+0000","last_became_active":"2023-10-06T04:16:50.616213+0000","last_became_peered":"2023-10-06T04:16:50.616213+0000","last_unstale":"2023-10-06T04:19:29.808446+0000","last_undegraded":"2023-10-06T04:19:29.808446+0000","last_fullsized":"2023-10-06T04:19:29.808446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:29.808232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:29.808232+0000","last_clean_scrub_stamp":"2023-10-06T04:19:29.808232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:19.920194+0000","scrub_duration":0.0023213359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:33.861123+0000","last_change":"2023-10-06T04:19:33.861076+0000","last_active":"2023-10-06T04:19:33.861123+0000","last_peered":"2023-10-06T04:19:33.861123+0000","last_clean":"2023-10-06T04:19:33.861123+0000","last_became_active":"2023-10-06T04:16:50.841802+0000","last_became_peered":"2023-10-06T04:16:50.841802+0000","last_unstale":"2023-10-06T04:19:33.861123+0000","last_undegraded":"2023-10-06T04:19:33.861123+0000","last_fullsized":"2023-10-06T04:19:33.861123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:33.860952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:33.860952+0000","last_clean_scrub_stamp":"2023-10-06T04:19:33.860952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:17.837420+0000","scrub_duration":0.0017845999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:32.917823+0000","last_change":"2023-10-06T04:19:32.917795+0000","last_active":"2023-10-06T04:19:32.917823+0000","last_peered":"2023-10-06T04:19:32.917823+0000","last_clean":"2023-10-06T04:19:32.917823+0000","last_became_active":"2023-10-06T04:16:50.616501+0000","last_became_peered":"2023-10-06T04:16:50.616501+0000","last_unstale":"2023-10-06T04:19:32.917823+0000","last_undegraded":"2023-10-06T04:19:32.917823+0000","last_fullsized":"2023-10-06T04:19:32.917823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:32.917676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:32.917676+0000","last_clean_scrub_stamp":"2023-10-06T04:19:32.917676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:37.670272+0000","scrub_duration":0.0019906530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":193,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:29.912768+0000","last_change":"2023-10-06T04:19:29.912735+0000","last_active":"2023-10-06T04:19:29.912768+0000","last_peered":"2023-10-06T04:19:29.912768+0000","last_clean":"2023-10-06T04:19:29.912768+0000","last_became_active":"2023-10-06T04:16:43.530064+0000","last_became_peered":"2023-10-06T04:16:43.530064+0000","last_unstale":"2023-10-06T04:19:29.912768+0000","last_undegraded":"2023-10-06T04:19:29.912768+0000","last_fullsized":"2023-10-06T04:19:29.912768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-10-06T04:19:29.912607+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-10-06T04:19:29.912607+0000","last_clean_scrub_stamp":"2023-10-06T04:19:29.912607+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:40.813980+0000","scrub_duration":0.0056646650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:30.877939+0000","last_change":"2023-10-06T04:19:30.877912+0000","last_active":"2023-10-06T04:19:30.877939+0000","last_peered":"2023-10-06T04:19:30.877939+0000","last_clean":"2023-10-06T04:19:30.877939+0000","last_became_active":"2023-10-06T04:16:50.616986+0000","last_became_peered":"2023-10-06T04:16:50.616986+0000","last_unstale":"2023-10-06T04:19:30.877939+0000","last_undegraded":"2023-10-06T04:19:30.877939+0000","last_fullsized":"2023-10-06T04:19:30.877939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:30.877798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:30.877798+0000","last_clean_scrub_stamp":"2023-10-06T04:19:30.877798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:17.625345+0000","scrub_duration":0.0020594440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:31.865702+0000","last_change":"2023-10-06T04:19:31.865673+0000","last_active":"2023-10-06T04:19:31.865702+0000","last_peered":"2023-10-06T04:19:31.865702+0000","last_clean":"2023-10-06T04:19:31.865702+0000","last_became_active":"2023-10-06T04:16:50.903604+0000","last_became_peered":"2023-10-06T04:16:50.903604+0000","last_unstale":"2023-10-06T04:19:31.865702+0000","last_undegraded":"2023-10-06T04:19:31.865702+0000","last_fullsized":"2023-10-06T04:19:31.865702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:31.865569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:31.865569+0000","last_clean_scrub_stamp":"2023-10-06T04:19:31.865569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:34.943017+0000","scrub_duration":0.0021769630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:27.424173+0000","last_change":"2023-10-06T04:19:27.424141+0000","last_active":"2023-10-06T04:19:27.424173+0000","last_peered":"2023-10-06T04:19:27.424173+0000","last_clean":"2023-10-06T04:19:27.424173+0000","last_became_active":"2023-10-06T04:16:50.616258+0000","last_became_peered":"2023-10-06T04:16:50.616258+0000","last_unstale":"2023-10-06T04:19:27.424173+0000","last_undegraded":"2023-10-06T04:19:27.424173+0000","last_fullsized":"2023-10-06T04:19:27.424173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:27.423974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:27.423974+0000","last_clean_scrub_stamp":"2023-10-06T04:19:27.423974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:11.400442+0000","scrub_duration":0.0018969099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:19:30.749497+0000","last_change":"2023-10-06T04:19:30.749449+0000","last_active":"2023-10-06T04:19:30.749497+0000","last_peered":"2023-10-06T04:19:30.749497+0000","last_clean":"2023-10-06T04:19:30.749497+0000","last_became_active":"2023-10-06T04:16:50.618255+0000","last_became_peered":"2023-10-06T04:16:50.618255+0000","last_unstale":"2023-10-06T04:19:30.749497+0000","last_undegraded":"2023-10-06T04:19:30.749497+0000","last_fullsized":"2023-10-06T04:19:30.749497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:19:30.749332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:19:30.749332+0000","last_clean_scrub_stamp":"2023-10-06T04:19:30.749332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:22.411908+0000","scrub_duration":0.0015544059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.0329999999999999,"15min":1.129},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.57199999999999995,"5min":11.148999999999999,"15min":11.148999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.60999999999999999},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.56200000000000006,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.95899999999999996,"15min":1.03},"min":{"1min":0.436,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.59699999999999998,"5min":11.288,"15min":11.288},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.90900000000000003,"15min":0.97999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61499999999999999,"5min":11.271000000000001,"15min":11.271000000000001},"last":0.5}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.90800000000000003,"15min":0.98399999999999999},"min":{"1min":0.33600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52800000000000002,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.98299999999999998,"15min":1.0580000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.65600000000000003,"5min":11.33,"15min":11.33},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.60199999999999998,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.72899999999999998,"15min":0.755},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.67700000000000005,"5min":4.2530000000000001,"15min":4.2530000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42399999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.745,"15min":0.745},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.51400000000000001,"15min":0.52300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.624,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.68400000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.625},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.63600000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61599999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70199999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.71999999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.47099999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.42399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40699999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.50800000000000001,"5min":0.752,"15min":0.752},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41799999999999998,"15min":0.42299999999999999},"min":{"1min":0.31,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49099999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77800000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":1.002,"15min":1.002},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76700000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63800000000000001,"15min":0.64800000000000002},"min":{"1min":0.44700000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71899999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.624,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.623},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.49399999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.80100000000000005,"5min":1.046,"15min":1.046},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.49399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76100000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.78100000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298312,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073528,"statfs":{"total":96636764160,"available":96331292672,"internally_reserved":0,"allocated":1048576,"data_stored":778146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.376},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.53400000000000003,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41099999999999998,"15min":0.40100000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66400000000000003,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32500000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51100000000000001,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.38,"15min":0.39100000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41299999999999998,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58299999999999996,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56499999999999995,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.67000000000000004,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.6030000000000002,"5min":5.7000000000000002,"15min":5.7000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.624,"15min":0.60099999999999998},"min":{"1min":0.49199999999999999,"5min":0.433,"15min":0.433},"max":{"1min":3.6200000000000001,"5min":3.6200000000000001,"15min":3.6200000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85199999999999998,"5min":5.7460000000000004,"15min":5.7460000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.6299999999999999,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.625},"min":{"1min":0.45200000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.874,"5min":5.7320000000000002,"15min":5.7320000000000002},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.623},"min":{"1min":0.42899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84199999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.621,"15min":0.62},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.74299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.23200000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.42299999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.317,"5min":0.34599999999999997,"15min":0.35099999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.28199999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47799999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.40999999999999998,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.45800000000000002,"5min":0.629,"15min":0.629},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.86799999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.45600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.752,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.629,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.93600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33200000000000002,"15min":0.33400000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.378},"min":{"1min":0.27000000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.314,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59199999999999997},"min":{"1min":0.44400000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89900000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.877,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57499999999999996,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.623}]},{"osd":7,"last update":"Fri Oct 6 04:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81999999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":1.141,"15min":1.141},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57899999999999996,"5min":0.746,"15min":0.746},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70999999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64200000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65900000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.5}]},{"osd":3,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.58799999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:18:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.375},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.79900000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":454656,"data_stored":187778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52900000000000003,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.45800000000000002},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63100000000000001,"5min":0.747,"15min":0.747},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.35099999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":8.7170000000000005,"5min":8.7170000000000005,"15min":8.7170000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.61299999999999999,"15min":0.55100000000000005},"min":{"1min":0.42399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.6690000000000005,"5min":8.6690000000000005,"15min":8.6690000000000005},"last":0.624}]},{"osd":3,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.5},"min":{"1min":0.38600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.64800000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.749,"15min":0.749},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:19:49.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:19:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.133+0000 7fda61960700 1 Processor -- start 2023-10-06T04:19:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.133+0000 7fda61960700 1 -- start start 2023-10-06T04:19:49.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda61960700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fda5c0cb400 0x7fda5c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda61960700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c067660 con 0x7fda5c0cb030 2023-10-06T04:19:49.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda61960700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c067f00 con 0x7fda5c0c75b0 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda61960700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0c7d80 con 0x7fda5c0cb400 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda5affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda5c0cb030 0x7fda5c0a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36732/0 (socket says 172.21.15.37:36732) 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.134+0000 7fda5affd700 1 -- 172.21.15.37:0/3764742422 learned_addr learned my addr 172.21.15.37:0/3764742422 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862321346 0 0) 0x7fda5c067660 con 0x7fda5c0cb030 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5a7fc700 1 --2- 172.21.15.37:0/3764742422 >> v2:172.21.15.83:3300/0 conn(0x7fda5c0cb400 0x7fda5c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda48003570 con 0x7fda5c0cb030 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4028638874 0 0) 0x7fda48003570 con 0x7fda5c0cb030 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 >> v2:172.21.15.83:3300/0 conn(0x7fda5c0cb400 msgr2=0x7fda5c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 --2- 172.21.15.37:0/3764742422 >> v2:172.21.15.83:3300/0 conn(0x7fda5c0cb400 0x7fda5c0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 >> v1:172.21.15.83:6789/0 conn(0x7fda5c0c75b0 legacy=0x7fda5c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0cb8a0 con 0x7fda5c0cb030 2023-10-06T04:19:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4252865645 0 0) 0x7fda4c0017f0 con 0x7fda5c0cb030 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 >> v1:172.21.15.37:6789/0 conn(0x7fda5c0cb030 legacy=0x7fda5c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda48003a60 0x7fda48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda48004810 0x7fda48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 0x7fda4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c7d80 con 0x7fda480051c0 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800c0d0 con 0x7fda48004810 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800c290 con 0x7fda48003a60 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 0x7fda4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5a7fc700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda48004810 0x7fda48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5affd700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda48003a60 0x7fda48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 -- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda48003a60 msgr2=0x7fda48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda48003a60 0x7fda48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 -- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda48004810 msgr2=0x7fda48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda48004810 0x7fda48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.135+0000 7fda5b7fe700 1 -- 172.21.15.37:0/3764742422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48003570 con 0x7fda480051c0 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda5b7fe700 1 -- 172.21.15.37:0/3764742422 reap_dead start 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 0x7fda4800ba60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda54001880 tx=0x7fda54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6122f156f5d6b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54012420 con 0x7fda480051c0 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540125a0 con 0x7fda480051c0 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda59ffb700 1 -- 172.21.15.37:0/3764742422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54012960 con 0x7fda480051c0 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 -- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 msgr2=0x7fda4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 0x7fda4800ba60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda54001880 tx=0x7fda54007d30 comp rx=0 tx=0).stop 2023-10-06T04:19:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 -- 172.21.15.37:0/3764742422 shutdown_connections 2023-10-06T04:19:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 --2- 172.21.15.37:0/3764742422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda480051c0 0x7fda4800ba60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 -- 172.21.15.37:0/3764742422 >> 172.21.15.37:0/3764742422 conn(0x7fda5c0c9540 msgr2=0x7fda5c0c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 -- 172.21.15.37:0/3764742422 shutdown_connections 2023-10-06T04:19:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.136+0000 7fda61960700 1 -- 172.21.15.37:0/3764742422 wait complete. 2023-10-06T04:19:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.138+0000 7fda61960700 1 Processor -- start 2023-10-06T04:19:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.138+0000 7fda61960700 1 -- start start 2023-10-06T04:19:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.138+0000 7fda61960700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 0x7fda5c0c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.138+0000 7fda61960700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 0x7fda5c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c4c40 con 0x7fda5c151270 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c40c0 con 0x7fda480051c0 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c43a0 con 0x7fda5c152cc0 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53824/0 (socket says 172.21.15.37:53824) 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 -- 172.21.15.37:0/955546914 learned_addr learned my addr 172.21.15.37:0/955546914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5a7fc700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 0x7fda5c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 -- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 msgr2=0x7fda5c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5affd700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 0x7fda5c0c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 0x7fda5c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 -- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 msgr2=0x7fda5c0c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 0x7fda5c0c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 -- 172.21.15.37:0/955546914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0c4680 con 0x7fda5c151270 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5a7fc700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 0x7fda5c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5affd700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 0x7fda5c0c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda5b7fe700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fda54001880 tx=0x7fda54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54012420 con 0x7fda5c151270 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54001200 con 0x7fda5c151270 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0c4960 con 0x7fda5c151270 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54011df0 con 0x7fda5c151270 2023-10-06T04:19:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.139+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0a9e20 con 0x7fda5c151270 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.140+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c063410 con 0x7fda5c151270 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.141+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda5401e640 con 0x7fda5c151270 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.141+0000 7fda52ffd700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 0x7fda3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.141+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fda540858e0 con 0x7fda5c151270 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.141+0000 7fda5affd700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 0x7fda3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.142+0000 7fda5affd700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 0x7fda3c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00a0c0 tx=0x7fda4c006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.145+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda54052cf0 con 0x7fda5c151270 2023-10-06T04:19:49.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.338+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fda5c0c7aa0 con 0x7fda5c151270 2023-10-06T04:19:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.345+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fda54052cf0 con 0x7fda5c151270 2023-10-06T04:19:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.345+0000 7fda52ffd700 1 -- 172.21.15.37:0/955546914 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fda54017070 con 0x7fda5c151270 2023-10-06T04:19:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 msgr2=0x7fda3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 0x7fda3c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00a0c0 tx=0x7fda4c006040 comp rx=0 tx=0).stop 2023-10-06T04:19:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 msgr2=0x7fda5c0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fda54001880 tx=0x7fda54015000 comp rx=0 tx=0).stop 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 shutdown_connections 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda5c151270 0x7fda5c0a98e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fda3c066f30 0x7fda3c0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda480051c0 0x7fda5c0c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.347+0000 7fda61960700 1 --2- 172.21.15.37:0/955546914 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda5c152cc0 0x7fda5c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.348+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 >> 172.21.15.37:0/955546914 conn(0x7fda5c0c9540 msgr2=0x7fda5c0aa640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.348+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 shutdown_connections 2023-10-06T04:19:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.348+0000 7fda61960700 1 -- 172.21.15.37:0/955546914 wait complete. 2023-10-06T04:19:49.362 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:19:49.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:19:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.479+0000 7fab885d7700 1 Processor -- start 2023-10-06T04:19:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.479+0000 7fab885d7700 1 -- start start 2023-10-06T04:19:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab885d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab800c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab885d7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab80157710 0x7fab800cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab885d7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab800c9730 con 0x7fab800cc9b0 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab885d7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800cce30 con 0x7fab80157710 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab885d7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015e4a0 con 0x7fab80157340 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab80157710 0x7fab800cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab86b74700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab800cc9b0 0x7fab8015d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36744/0 (socket says 172.21.15.37:36744) 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab86b74700 1 -- 172.21.15.37:0/634715420 learned_addr learned my addr 172.21.15.37:0/634715420 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab86373700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab800c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 -- 172.21.15.37:0/634715420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 msgr2=0x7fab800c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:19:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab800c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 -- 172.21.15.37:0/634715420 >> v1:172.21.15.37:6789/0 conn(0x7fab800cc9b0 legacy=0x7fab8015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85371700 1 -- 172.21.15.37:0/634715420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309392273 0 0) 0x7fab800c9730 con 0x7fab800cc9b0 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 -- 172.21.15.37:0/634715420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800c8e00 con 0x7fab80157710 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85b72700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab80157710 0x7fab800cc470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab740098e0 tx=0x7fab740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacbd07a0a9c222f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85371700 1 -- 172.21.15.37:0/634715420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74009e80 con 0x7fab80157710 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85371700 1 -- 172.21.15.37:0/634715420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fab7400b860 con 0x7fab80157710 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.480+0000 7fab85371700 1 -- 172.21.15.37:0/634715420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7400bc00 con 0x7fab80157710 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 -- 172.21.15.37:0/634715420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab80157710 msgr2=0x7fab800cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab80157710 0x7fab800cc470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab740098e0 tx=0x7fab740091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 -- 172.21.15.37:0/634715420 shutdown_connections 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab800c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 --2- 172.21.15.37:0/634715420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab80157710 0x7fab800cc470 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 -- 172.21.15.37:0/634715420 >> 172.21.15.37:0/634715420 conn(0x7fab8006baa0 msgr2=0x7fab8006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 -- 172.21.15.37:0/634715420 shutdown_connections 2023-10-06T04:19:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.481+0000 7fab885d7700 1 -- 172.21.15.37:0/634715420 wait complete. 2023-10-06T04:19:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.482+0000 7fab885d7700 1 Processor -- start 2023-10-06T04:19:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.482+0000 7fab885d7700 1 -- start start 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab80152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab80157710 0x7fab80154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801596c0 con 0x7fab800cc9b0 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80158ab0 con 0x7fab80157710 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab885d7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80158d90 con 0x7fab80157340 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53850/0 (socket says 172.21.15.37:53850) 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 -- 172.21.15.37:0/3502133384 learned_addr learned my addr 172.21.15.37:0/3502133384 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T04:19:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86b74700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab80157710 0x7fab80154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab85b72700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab80152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 -- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 msgr2=0x7fab80152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab80152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 -- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab80157710 msgr2=0x7fab80154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab80157710 0x7fab80154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab86373700 1 -- 172.21.15.37:0/3502133384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009420 con 0x7fab800cc9b0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.483+0000 7fab85b72700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab80152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab86373700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab78009fd0 tx=0x7fab78009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800edd0 con 0x7fab800cc9b0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fab78014420 con 0x7fab800cc9b0 2023-10-06T04:19:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab80159070 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78014800 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.484+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab801587a0 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.485+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab80063410 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.485+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab78014bb0 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.485+0000 7fab7e7fc700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 0x7fab6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.486+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fab78084be0 con 0x7fab800cc9b0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.486+0000 7fab85b72700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 0x7fab6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:19:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.486+0000 7fab85b72700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 0x7fab6c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab8015abe0 tx=0x7fab740091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:19:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.490+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab78052070 con 0x7fab800cc9b0 2023-10-06T04:19:49.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.727+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab800c90e0 con 0x7fab800cc9b0 2023-10-06T04:19:49.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.727+0000 7fab7e7fc700 1 -- 172.21.15.37:0/3502133384 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fab78009ab0 con 0x7fab800cc9b0 2023-10-06T04:19:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T04:19:49.730 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/702510982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":702510982},{"type":"v1","addr":"172.21.15.83:6836","nonce":702510982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4858,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2511658250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":2511658250},{"type":"v1","addr":"172.21.15.83:6837","nonce":2511658250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2330799782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2330799782},{"type":"v1","addr":"172.21.15.37:6833","nonce":2330799782}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2752728458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2752728458},{"type":"v1","addr":"172.21.15.37:6835","nonce":2752728458}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-06T04:19:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 msgr2=0x7fab6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 0x7fab6c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fab8015abe0 tx=0x7fab740091a0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 msgr2=0x7fab80158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab78009fd0 tx=0x7fab78009970 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 shutdown_connections 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:6832/90301,v1:172.21.15.83:6833/90301] conn(0x7fab6c066f30 0x7fab6c0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab80157710 0x7fab80154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab800cc9b0 0x7fab80158260 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 --2- 172.21.15.37:0/3502133384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab80157340 0x7fab80152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 >> 172.21.15.37:0/3502133384 conn(0x7fab8006baa0 msgr2=0x7fab80154030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 shutdown_connections 2023-10-06T04:19:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T04:19:49.730+0000 7fab885d7700 1 -- 172.21.15.37:0/3502133384 wait complete. 2023-10-06T04:19:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 19 2023-10-06T04:19:49.744 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:19:49.744 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:19:49.745 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:19:49.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.753 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:19:49.753 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:19:49.754 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.802 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:19:49.802 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:19:49.802 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.813 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:19:49.814 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:19:49.814 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.865 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:19:49.866 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:19:49.866 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:19:49.866 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.891 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:19:49.891 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:19:49.891 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:49.957 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:19:49.958 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:19:49.958 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.030 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:19:50.031 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:19:50.031 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.094 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:19:50.094 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:19:50.094 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.139 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:19:50.139 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:19:50.139 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.173 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:19:50.173 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:19:50.173 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.239 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:19:50.239 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:19:50.239 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.304 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:19:50.304 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:19:50.304 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:19:50.304 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.327 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:19:50.327 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:19:50.327 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.371 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:19:50.372 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:19:50.372 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:19:50.372 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.384 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:19:50.384 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:19:50.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.423 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:19:50.423 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:19:50.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:19:50.475 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:19:50.475 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:19:50.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:19:50.504 INFO:teuthology.orchestra.run.smithi037.stdout:1696565803.6466475 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:19:50.504 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:19:50.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:19:50.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:19:50.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:19:50.711 INFO:teuthology.orchestra.run.smithi037.stdout:1696565803.6466475 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:19:50.711 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:50.712 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:19:50.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:50.992 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:19:51.096 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:51.096 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:19:51.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:51.151 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:19:51.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:19:51.230 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:19:51.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:19:51.423 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:19:51.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:19:51.511 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:19:51.582 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:19:51.582 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:19:51.656 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:19:51.657 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/data/mon.a.tgz 2023-10-06T04:19:51.658 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T04:19:51.674 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.sEJO8TMupc 2023-10-06T04:19:51.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sEJO8TMupc 2023-10-06T04:19:51.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.sEJO8TMupc 2023-10-06T04:19:51.892 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.sEJO8TMupc is 290KB 2023-10-06T04:19:51.987 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.sEJO8TMupc 2023-10-06T04:19:52.002 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/data/mon.b.tgz 2023-10-06T04:19:52.002 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:19:52.018 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.8IQjHtnBfm 2023-10-06T04:19:52.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8IQjHtnBfm 2023-10-06T04:19:52.169 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.8IQjHtnBfm 2023-10-06T04:19:52.250 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.8IQjHtnBfm is 384KB 2023-10-06T04:19:52.346 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.8IQjHtnBfm 2023-10-06T04:19:52.361 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/data/mon.c.tgz 2023-10-06T04:19:52.361 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2023-10-06T04:19:52.415 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.A73tMNSA0I 2023-10-06T04:19:52.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.A73tMNSA0I 2023-10-06T04:19:52.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.A73tMNSA0I 2023-10-06T04:19:52.629 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.A73tMNSA0I is 384KB 2023-10-06T04:19:52.726 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.A73tMNSA0I 2023-10-06T04:19:52.740 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:19:52.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:19:52.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:19:52.805 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:19:52.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:19:52.810 DEBUG:teuthology.orchestra.run.smithi083:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:19:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:19:52.869 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:19:52.875 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:19:52.877 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi037/crash 2023-10-06T04:19:52.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:19:52.907 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi083/crash 2023-10-06T04:19:52.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:19:52.938 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:19:52.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:52.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:53.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:53.060 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:19:53.084 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:19:53.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:19:53.103 DEBUG:teuthology.orchestra.run.smithi083:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:19:54.298 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:19:54.298 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi037/log 2023-10-06T04:19:54.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:19:54.621 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi083/log 2023-10-06T04:19:54.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:19:54.786 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:19:54.812 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:19:54.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:19:54.815 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:19:54.891 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:19:54.902 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:19:54.903 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:19:54.905 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:19:54.917 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-06T04:19:54.919 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-10-06T04:19:54.921 INFO:teuthology.orchestra.run.smithi037.stdout:210 Number of sources = 4 2023-10-06T04:19:54.921 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:19:54.922 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-06T04:19:54.922 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 61 +501us[ +501us] +/- 74ms 2023-10-06T04:19:54.922 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -523us[ -525us] +/- 62ms 2023-10-06T04:19:54.922 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +139us[ +138us] +/- 69ms 2023-10-06T04:19:54.922 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:210 Number of sources = 4 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +498us[ +501us] +/- 75ms 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -515us[ -512us] +/- 62ms 2023-10-06T04:19:54.923 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +135us[ +138us] +/- 69ms 2023-10-06T04:19:54.924 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:19:54.924 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:19:54.934 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:19:54.934 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:19:54.946 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:19:55.060 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:19:55.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:19:55.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:55.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:19:55.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:55.210 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:19:55.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:19:55.231 INFO:teuthology.task.internal:Duration was 916.523326 seconds 2023-10-06T04:19:55.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:19:55.241 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:19:55.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:19:55.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:19:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:19:55.293 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:19:55.554 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:19:55.554 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T04:19:55.554 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:19:55.574 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2023-10-06T04:19:55.575 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:19:55.613 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:19:55.613 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:19:55.616 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:19:55.691 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:19:55.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:19:55.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:19:55.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:19:55.815 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:19:55.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:19:55.841 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:19:55.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:19:55.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:19:55.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:19:55.906 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-10-06T04:19:55.929 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2023-10-06T04:19:55.943 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:19:55.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:55.975 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:19:55.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:19:55.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:19:56.008 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:19:56.009 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi037 2023-10-06T04:19:56.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:19:56.053 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250/remote/smithi083 2023-10-06T04:19:56.053 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:19:56.088 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:19:56.089 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:19:56.091 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:19:56.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:19:56.148 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:19:56.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:19:56.160 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:19:56.160 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:19:56.165 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:19:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:19 /home/ubuntu/cephtest 2023-10-06T04:19:56.191 INFO:teuthology.orchestra.run.smithi083.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:19 /home/ubuntu/cephtest 2023-10-06T04:19:56.192 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:19:56.206 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:19:56.234 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:19:56.260 DEBUG:teuthology.nuke:shortname: smithi037 2023-10-06T04:19:56.261 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:19:56.283 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-06T04:19:56.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:19:56.287 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:57:36.456925', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC86wr1epLFbSfu8kXLD/mAFRYoAYEm737l133EOAsPylg5zNKnwXLt8DWx+LiEOROKV1INS76Nhw67lviJRgD8='} 2023-10-06T04:19:56.304 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:57:36.454974', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN7DKOYjzxAnIu5A0szzJ095WnezlykVsQEtF7MrxPlN8VW8MSmRu4CXSgREMecIHe4iXfoDPxKJffjUr19J6mU='} 2023-10-06T04:19:56.335 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-06T04:19:56.336 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:19:56.359 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-06T04:19:56.359 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:19:56.379 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-06T04:19:56.379 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:19:56.389 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T04:19:56.401 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-06T04:19:56.401 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:19:56.427 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T04:20:00.391 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:20:00.428 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:20:00.502 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T04:20:00.539 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-06T04:20:04.504 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:20:04.540 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:20:04.613 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-06T04:20:04.650 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-06T04:20:04.714 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-06T04:20:04.751 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-06T04:20:04.857 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} duration: 916.5233261585236 failure_reason: '"1696565803.6466475 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:20:04.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:20:04.941 INFO:teuthology.run:FAIL